C3
Optimization for ML
5 lessons2.5 hoursPlannedFree
Outcome
Implement and diagnose gradient-based optimizers.
Prerequisites
- Recommended: C1 Linear Algebra and Probability for ML
Lessons
- L01Gradient descent and the loss landscape · coming soonExercise: Optimize a 2D function and plot the path.
- L02Learning rate effects · coming soonExercise: Sweep learning rates and report divergence.
- L03Stochastic gradient descent and mini-batches · coming soonExercise: Compare batch sizes on noise and speed.
- L04Momentum and Adam · coming soonExercise: Implement Adam from the equations.
- L05Diagnosing a run that won't converge · coming soonExercise: A debugging checklist applied to a broken script.