Data & Features
The Test Your Model Can't See
6 min+55 XPStep 1/10
The exam you can't cheat on
A student who memorizes the practice exam but can't solve new problems hasn't learned — they've memorized. Same for models.
So we hide part of the data — the test set — and only evaluate on it at the end. Performance on unseen data is the only honest measure of whether the model learned general patterns.
insight
Training accuracy tells you how well the model memorized. Test accuracy tells you how well it learned.