AI & Machine Learning Training, Validation & Test Sets Quiz

How you split your data decides whether your accuracy number means anything. This quiz tests the roles of training, validation and test sets, cross-validation, stratification, time-based splits and the data leakage traps interviewers love to ask about.

Medium 10 questions ~6 minutes Pass at 80%

Choose a mode

Playing as a guest: sign in to keep your XP and streak.

Sample question

Question 1 of 10

What is the validation set used for?

Show the answer

C. Comparing models and tuning hyperparameters during development The training set fits parameters, the validation set guides choices like model type or learning rate, and the test set gives the final estimate. Using one set for two of these jobs makes results optimistic.

What this quiz covers

  • The job of each split
  • Why the test set is used only once, at the end
  • k-fold cross-validation and stratified splits
  • Splitting time series and grouped data
  • Data leakage from preprocessing and duplicates

Questions people ask

Do I need an account?

No. Anyone can play. Sign in to keep your XP, streak, badges and history.

Can I retake it?

Yes. Your best score is kept, and the questions and answers are shuffled each time.