Quiz di AI & Machine Learning: Tokenization & Embeddings

Before a language model can read anything, text is split into tokens and each token is mapped to a vector. This quiz checks how subword tokenizers like BPE work, what embeddings are and why they explain some surprising LLM behaviour.

Medio 10 domande ~6 minuti Superato con il 80%

Scegli una modalità

Stai giocando come ospite: accedi per salvare XP e serie.

Domanda di esempio

Domanda 1 di 10

Why do most modern language models use subword tokenization instead of one token per whole word?

Mostra la risposta

B. A fixed-size vocabulary can still represent rare and unseen words by splitting them into known pieces A whole-word vocabulary would be huge and still miss new words, typos and names. Subwords keep the vocabulary manageable: common words stay one token while rare ones split into pieces like token + ization.

Cosa copre questo quiz

  • Why subword tokenization beats whole words and single characters
  • How byte pair encoding (BPE) builds its vocabulary
  • Embeddings as learned dense vectors and cosine similarity
  • Static vs contextual embeddings
  • Token quirks such as letter counting and non-English text

Domande frequenti

Serve un account?

No. Chiunque può giocare. Accedi per salvare XP, serie, badge e cronologia.

Posso rifarlo?

Sì. Il tuo miglior punteggio resta salvato, e domande e risposte vengono mescolate ogni volta.