Skip to content

Generalization

Train/Validation/Test Done Right

7 min+70 XPStep 1/11

Three splits, three jobs

You've met the test set — but honest evaluation actually needs three partitions, each with a single job:

  • Training set: the data the model learns from
  • Validation set: the data you learn from — every choice of learning rate, architecture, or feature set is judged here
  • Test set: the untouched final exam, used once at the end

Why the middle split? Because tuning on the test set is still fitting to it — through your decisions rather than the model's weights.

analogy

Training is practice problems. Validation is the mock exam that tells you which study strategy works. The test is the real exam — and you only get to take it once.