Quiz de AI & Machine Learning: The Attention Mechanism

Attention lets each token pull in information from the other tokens in the sequence. This hard quiz checks that you understand scaled dot-product attention in detail, from the roles of queries, keys and values to masking, cost and what is actually learned.

Difícil 10 perguntas ~8 minutos Aprovação com 80%

Escolha um modo

Jogando como visitante: entre para guardar seu XP e sua sequência.

Pergunta de exemplo

Pergunta 1 de 10

In self-attention, which description of queries, keys and values is right?

Mostrar a resposta

C. A query is what a token is looking for, a key is what each token offers to be matched against, and a value is the content that gets mixed into the output Each token's query is compared with every key to get scores, and the softmaxed scores weight the values. All three come from the same input but through different learned projections, so they play different roles.

O que este quiz cobre

  • The roles of queries, keys and values
  • The formula softmax(QK^T / sqrt(d_k)) V
  • Why scores are divided by the square root of the key size
  • Masking with negative infinity before softmax
  • Quadratic cost and permutation behaviour of self-attention

Perguntas frequentes

Preciso de uma conta?

Não. Qualquer pessoa pode jogar. Entre para guardar seu XP, sequência, badges e histórico.

Posso refazer?

Pode. Sua melhor nota fica salva, e as perguntas e respostas são embaralhadas a cada vez.