- Executors
-
Learn
Learn Python Runnable examples, NumPy, pandas, and more Learn AI / Machine LearningNeural networks, ML and LLMs from scratch Learn C & C++ Pointers, memory, STL, and modern C++ Learn C#C# basics, OOP, LINQ, async, and .NET exercises Learn MatplotlibLine, bar, scatter and pie charts with live visualizers Learn RustOwnership, traits, error handling, and threads Learn GoSlices, interfaces, goroutines, and channels Python Algorithms Search, sorting, recursion, and visualizers O(n) C & C++ Algorithms Compare algorithms implemented in C and C++ Coding for Kids Learn to code by playing!
- QuizzesNew
- ChallengesNew
- For TeachersNew
- Updates
- Buy me a coffee
AI & Machine Learning Transformer Architecture Quiz
The transformer is the architecture behind modern language models. This hard, interview-style quiz checks how the pieces fit together, from encoder-only and decoder-only models to positional encoding, causal masking, multi-head attention and the blocks around it.
Sample question
Question 1 of 10Which pairing of model family and architecture is right?
Show the answer
C. BERT: encoder-only; GPT-style models: decoder-only BERT stacks encoder blocks that see the whole input in both directions, which suits understanding tasks. GPT-style models stack decoder blocks with a causal mask, which suits generating text left to right; the original transformer for translation used both.
What this quiz covers
- Encoder-only, decoder-only and encoder-decoder models
- Positional encodings, including rotary embeddings (RoPE)
- Causal masking and why training can run in parallel
- Multi-head attention and head sizes
- Residual connections, layer norm and the feed-forward block
Questions people ask
Do I need an account?
No. Anyone can play. Sign in to keep your XP, streak, badges and history.
Can I retake it?
Yes. Your best score is kept, and the questions and answers are shuffled each time.