Schedule
| Date | Lecture | Readings | Logistics | |
|---|---|---|---|---|
| Module 1: Foundations of PGMs and Exact Inference | ||||
| 1/21 |
Lecture #1
(Prof. Lengerich):
Course Introduction, Introduction to PGMs [ slides | video | notes ] |
|||
| 1/23 |
Lecture #2
(Prof. Lengerich):
Statistical Review & Maximum LIkelihood Estimation [ slides | video | notes ] |
HW1 Out |
||
| 1/28 |
Lecture #3
(Prof. Lengerich):
A Linear view of Discriminative and Generative Models [ slides | video | notes ] |
|
||
| 1/30 |
Lecture #4
(Prof. Lengerich):
Conditional Independence and Directed GMs (BNs) [ slides | video | notes ] |
|
||
| 2/4 |
Lecture #5
(Prof. Lengerich):
Undirected GMs (MRFs) [ slides | video | notes ] |
|
||
| 2/6 |
Lecture #6
(Prof. Lengerich):
Exact Inference 1 - Variable Elimination [ slides | video | notes ] |
|
||
| 2/11 |
Lecture #7
(Prof. Lengerich):
Exact inference 2 - Clique trees, Message passing, Sum product algorithm [ slides | video | notes ] |
|
||
| 2/13 |
Lecture #8
:
Quiz [ slides | video | notes ] |
|||
| Module 2: Learning | ||||
| 2/18 |
Lecture #9
(Prof. Lengerich):
Learning Generalized Linear Models [ slides | video | notes ] |
|||
| 2/20 |
Lecture #10
(Prof. Lengerich):
Parameter Learning in Fully-Observed BNs [ slides | video | notes ] |
|||
| 2/25 |
Lecture #11
(Prof. Lengerich):
Learning Undirected GMs [ slides | video | notes ] |
|||
| 2/27 |
Lecture #12
(Prof. Lengerich):
Structure Learning [ slides | video | notes ] |
|||
| 3/4 |
Lecture #13
(Prof. Lengerich):
Causal Discovery [ slides | video | notes ] |
|||
| 3/6 |
Lecture #14
(Prof. Lengerich):
Parameter Learning of partially observed BNs [ slides | video | notes ] |
|||
| 3/11 |
Lecture #15
(Prof. Lengerich):
Sequential Models [ slides | video | notes ] |
|||
| 3/13 |
Lecture #16
(Prof. Lengerich):
Variational Inference, Monte Carlo [ slides | video | notes ] |
|||
| 3/18 |
Lecture #17
(Prof. Lengerich):
Review [ slides | video | notes ] |
|||
| 3/20 |
Lecture #18
(Prof. Lengerich):
Exam [ slides | video | notes ] |
|||
| 3/25 |
Lecture #19
(Prof. Lengerich):
Spring recess [ slides | video | notes ] |
|||
| 3/27 |
Lecture #20
(Prof. Lengerich):
Spring recess [ slides | video | notes ] |
|||
| Module 3: Modern Probabilistic AI | ||||
| 4/1 |
Lecture #21
(Prof. Lengerich):
Deep Learning from a GM Perspective [ slides | video | notes ] |
|||
| 4/3 |
Lecture #22
(Prof. Lengerich):
CNNs, RNNs, Autoencoders [ slides | video | notes ] |
|||
| 4/8 |
Lecture #23
:
Deep Generative Models: GAN, VAEs [ slides | video | notes ] |
|||
| 4/10 |
Lecture #24
(Prof. Lengerich):
Attention and Transformers [ slides | video | notes ] |
|||
| 4/15 |
Lecture #25
(Prof. Lengerich):
LLMs from a Probabilistic Perspective 1: Implementing a GPT from Scratch [ slides | video | notes ] |
|||
| 4/17 |
Lecture #26
(Prof. Lengerich):
LLMs from a Probabilistic Perspective 2: Training on Unlabeled Data [ slides | video | notes ] |
|||
| 4/22 |
Lecture #27
(Prof. Lengerich):
LLMs from a Probabilistic Perspective 3: Fine-tuning on Labeled Data [ slides | video | notes ] |
|||
| 4/24 |
Lecture #28
(Prof. Lengerich):
Context-Adaptive Graphical Models [ slides | video | notes ] |
|||
| 4/29 |
Lecture #29
:
Project Presentations [ slides | video | notes ] |
|||
| 5/1 | Project Presentations | |||