NLP, Transformers & LLMs Quizzes

How language models turn text into tokens and vectors, how attention and the transformer work, and how large language models generate text, get fine-tuned and use retrieval.

Intermediate 5 quizzes · 50 questions about 34 minutes
0/5passed Category exam 20 mixed questions. 80% earns a certificate.
Tags:
1 Tokenization & Embeddings Medium Learn how text becomes tokens and tokens become vectors that capture meaning. #nlp#tokenization 10 questions · ~6 min Not started Start
2 The Attention Mechanism Hard Queries, keys, values, softmax and the sqrt(d) scaling at the heart of every transformer. #attention#transformers 10 questions · ~8 min Not started Start
3 Transformer Architecture Hard Encoders, decoders, positional encoding, causal masks and multi-head attention, interview style. #transformers#interview 10 questions · ~8 min Not started Start
4 How LLMs Generate Text Medium Next-token prediction, logits, context windows and the difference between greedy decoding and sampling. #llm#text-generation 10 questions · ~6 min Not started Start
5 Fine-Tuning & RAG Medium When to fine-tune, when to retrieve, and the details that make retrieval-augmented generation work. #llm#rag 10 questions · ~6 min Not started Start