Quiz di AI & Machine Learning: How LLMs Generate Text

A large language model writes one token at a time, each chosen from a probability distribution over its vocabulary. This quiz checks how that loop works, what the context window limits, why answers vary between runs and why a chat model behaves differently from a base model.

Medio 10 domande ~6 minuti Superato con il 80%

Scegli una modalità

Stai giocando come ospite: accedi per salvare XP e serie.

Domanda di esempio

Domanda 1 di 10

What is the core pretraining objective of a GPT-style language model?

Mostra la risposta

B. Predict the next token given all the previous tokens Pretraining is next-token prediction over huge amounts of text, with the loss measuring how much probability the model gave the actual next token. Everything else, including answering questions, builds on that skill.

Cosa copre questo quiz

  • Next-token prediction and the autoregressive loop
  • Logits, softmax and probabilities over the vocabulary
  • Greedy decoding vs sampling
  • Context windows, statelessness and output limits
  • The KV cache and base vs instruction-tuned models

Domande frequenti

Serve un account?

No. Chiunque può giocare. Accedi per salvare XP, serie, badge e cronologia.

Posso rifarlo?

Sì. Il tuo miglior punteggio resta salvato, e domande e risposte vengono mescolate ogni volta.