AI & Machine Learning Training Deep Networks Quiz

This hard quiz is about what actually goes wrong when you train deep networks and how to fix it. It covers learning rates, dropout, batch normalization, vanishing and exploding gradients and early stopping, using situations you will meet in practice and in interviews.

Hard 10 questions ~8 minutes Pass at 80%

Choose a mode

Playing as a guest: sign in to keep your XP and streak.

Sample question

Question 1 of 10

Training loss keeps falling, but validation loss reaches its lowest point at epoch 12 and rises after that. What is happening and what is a sensible response?

Show the answer

C. Overfitting; keep the weights from epoch 12 (early stopping) or add regularization After epoch 12 the model memorises the training data instead of learning patterns that generalise. Early stopping keeps the best validation checkpoint; dropout, weight decay or more data also help.

What this quiz covers

  • Spotting overfitting and stopping early
  • Dropout and batch norm at training vs inference time
  • Vanishing and exploding gradients, clipping and their fixes
  • Learning rate choice and schedules
  • Weight decay and other regularization

Questions people ask

Do I need an account?

No. Anyone can play. Sign in to keep your XP, streak, badges and history.

Can I retake it?

Yes. Your best score is kept, and the questions and answers are shuffled each time.