Lecture 1 — Overview, tokenization
•6 min read
Stanford CS336 Notes
This page hosts some of my CS336 (Spring 2025) course summary notes and exercise write-ups. See the course site and the YouTube playlist.
17 posts
Lecture 2 — PyTorch, resource accounting
•5 min read
Lecture 3 — Architectures, hyperparameters
•5 min read
Lecture 4 — Mixture of experts
•5 min read
Lecture 5 — GPUs
•5 min read
Lecture 6 — Kernels, Triton
•5 min read
Lecture 7 — Parallelism (Tatsu)
•4 min read
Lecture 8 — Parallelism (Percy)
•5 min read
Lecture 9 — Scaling laws
•5 min read
Lecture 10 — Inference
•7 min read
Lecture 11 — Scaling laws
•9 min read
Lecture 12 — Evaluation
•6 min read
Lecture 13 — Data
•6 min read
Lecture 14 — Data
•6 min read
Lecture 15 — Alignment: SFT/RLHF
•7 min read
Lecture 16 — Alignment: RL
•6 min read
Lecture 17 — Alignment: RL (Percy)
•7 min read
End of posts • 17 posts