C22
Monitoring and Rollouts
5 lessons3 hoursPlannedFree
Outcome
Monitor models in production and roll out changes safely.
Prerequisites
- Python basics.
Lessons
- L01What to monitor: inputs, outputs, latency, errors · coming soonExercise: Define a dashboard spec.
- L02Data and concept drift detection · coming soonExercise: Detect drift with a statistical test.
- L03Canary deployments · coming soonExercise: Route 5% of traffic and compare metrics.
- L04Shadow deployments · coming soonExercise: Run a candidate model silently and log differences.
- L05Rollback plans · coming soonExercise: Write and rehearse a rollback runbook.