Important Links
- Syllabus (pdf), tentative course schedule (pdf), and prerequisite quiz (ungraded)
- Brightspace (Grades) - For the first time logging into Piazza, Gradescope, or Circuit, please click the links in Brightspace under “Content” and then under the module “Piazza, Gradescope, and Circuit Links”. This will help link your Purdue account with these external learning tools. After the first time, you can just use the links below.
- Piazza (Announcements and discussion)
- Gradescope (Quizzes and assignment submission)
- Circuit (Project checkpoint submission and peer reviews)
- Google Colab (Free computing environment including GPUs)
Project Information
- Course project instructions
- Tutorials on specific research topics: TBD
- A few ideas for selecting papers: Lecture snippet from Fall 2022, Corresponding slides
Optional textbooks
The bracketed acronym is used for referencing these books.
- [DL] Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville, 2016. http://www.deeplearningbook.org
- [ML] Machine Learning: A Probabilistic Perspective by Kevin P. Murphy, 2012. https://ebookcentral.proquest.com/lib/purdue/detail.action?docID=3339490
- [PY] Python Data Science Handbook by Jake VanderPlas, 2016. https://jakevdp.github.io/PythonDataScienceHandbook/
- [DD] Dive into Deep Learning by Aston Zhang, Zachary C. Lipton, Mu Li, and Alexander J. Smola, 2023. https://d2l.ai/
Lecture content by week
- Week 1 - Introduction to artificial intelligence
- Monday: Introduction to AI. See syllabus, course schedule, and course project links above.
- Wednesday: (continued)
- Friday: Principal Components Analysis (PCA), Review of linear algebra (notebook, pdf); Related reading: DL, Ch.2
- Week 2 - PCA and linear algebra
- Monday: (continued)
- Wednesday: (continued), PCA demo (notebook, pdf )
- Friday: Intro. to ML; PCA generalization demo (notebook, pdf); Optional related reading: DL, Ch. 5.1
- Week 3 - Machine learning
- Monday: Labor day (no class)
- Wednesday: K-nearest neighbors (KNN) and evaluating ML methods, (pdf); KNN Demo (notebook, pdf); Optional related reading: KNN Classifier Notes, DL, Ch. 5.2-5.3
- Friday: Linear and Logistic Regression; Optional related reading: PY, Linear regression, DL, Ch. 5.1.4 (short), ML, Ch. 7 and Ch. 8 (in-depth)
- Week 4 - Linear models and gradient descent
- Monday: (continued)
- Wednesday: Gradient Descent; Gradient descent demo (notebook, pdf); Loss functions and regularization; Optional related reading: ML, Ch. 8 section 8.3
- (Optional) Thursday: Distribution Alignment Tutorial
- Friday: Broadcasting rules in NumPy (and PyTorch) (notebook, pdf)
- Week 5 - Basics of deep learning
- Monday: Basics of deep learning; PyTorch and automatic differentiation (notebook, pdf)
- Wednesday: Basics of convolutional neural networks (CNN); Convolutions demo (notebook, pdf); Optional related reading: DL, Ch. 9
- Friday: CNNs continued, CIFAR-10 demo with BatchNorm and residual networks (notebook, pdf)
- Week 6 - Natural Langauge Processing
- Monday: (continued)
- Wednesday: Recurrent Neural Networks (RNN); Demo of character-level RNN classification (tutorial data, notebook, pdf)
- Friday: (continued); Demo of character-level RNN generation (tutorial data, notebook, pdf); Demo of vanishing and exploding gradients (notebook, pdf);