Skip to content
Learn with AlakhSharma

C7

Evaluation and Pitfalls

5 lessons3 hoursPlannedFree

Outcome

Choose metrics, calibrate probabilities, and avoid common evaluation mistakes.

Prerequisites

Lessons

  1. L01Metrics: precision, recall, ROC-AUC, PR-AUC · coming soonExercise: Pick a metric for a stated business goal.
  2. L02Calibration and reliability diagrams · coming soonExercise: Calibrate with Platt scaling and isotonic regression.
  3. L03Data leakage · coming soonExercise: Find and fix a leaking feature.
  4. L04Class imbalance · coming soonExercise: Compare resampling and class weights.
  5. L05Cross-validation done right · coming soonExercise: Nested CV on a small dataset.