Important Links
- Syllabus (pdf), tentative course schedule (pdf), and prerequisite quiz (ungraded)
- Piazza (Announcements and discussion)
- Gradescope
- Brightspace (Grades only)
- Google Colab (Online computing environment including GPUs)
Assignments
Please review general instructions and submit assignments on Gradescope.
- Principles of Wise and Effective AI Use
- Numerical Linear Algebra Algorithms in NumPy
- Geometric Intelligence (SVD & PCA)
- Generalization Error, Distribution Shifts & Adversarial Attacks
- Logistic Regression
Optional textbooks
The bracketed acronym is used for referencing these books.
- [DD] Dive into Deep Learning by Aston Zhang, Zachary C. Lipton, Mu Li, and Alexander J. Smola, 2023. https://d2l.ai/
- [PPA] Patterns, predictions, and actions: A story about machine learning by Moritz Hardt and Benjamin Recht, 2022, https://mlstory.org/pdf/patterns.pdf
- [ML] Machine Learning: A Probabilistic Perspective by Kevin P. Murphy, 2012. https://ebookcentral.proquest.com/lib/purdue/detail.action?docID=3339490
- [PY] Python Data Science Handbook by Jake VanderPlas, 2016. https://jakevdp.github.io/PythonDataScienceHandbook/
- [DL] Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville, 2016. http://www.deeplearningbook.org
Lecture content by week
- Introduction to artificial intelligence
- Tuesday: Introduction to AI. See syllabus, course schedule, and course project links above.
- Thursday: Wise and Effective Use of Large Language Models
- Linear Algebra
- Tuesday: Linear Algebra Introduction (notebook); Brief Review of Linear Algebra with Numpy (notebook)
- Thursday: (Linear algebra continued); Related reading: DL, Ch.2
- Principal Component Analysis (PCA)
- Tuesday: Linear Dimensionality Reduction via PCA (notebook)
- Machine Learning
- Tuesday: Intro. to ML; Optional related reading: DL, Ch. 5.1; K-nearest neighbors (KNN) and evaluating ML methods, (pdf) (notebook); Optional related reading: KNN Classifier Notes, DL, Ch. 5.2-5.3
- Thursday: (KNN continued)
- Machine Learning
- Tuesday: Guest Lecture by Prof. Timothy Rogers - A Brief Tour of GPUs
- Thursday: Linear and Logistic Regression; Gradient Descent (notebook); Optional related reading: PY, Linear regression, DL, Ch. 5.1.4 (short), ML, Ch. 7 and Ch. 8 (in-depth)
- Deep Learning
- Tuesday: Loss functions and regularization ( notebook); Optional related reading: ML, Ch. 8 section 8.3; Basics of deep learning
- Thursday: (Deep Learning Continued) PyTorch and Automatic Differentiation (notebook, html)
- Convolutional Neural Networks
- Tuesday: Basics of convolutional neural networks (CNN) (notebook, html); CIFAR-10 demo (notebook, html); BatchNorm and Residual Networks (notebook, html); Optional related reading: DL, Ch. 9;
- Thursday: Midterm 1