How AI Chat Works

A chatbot has no hidden draft. At each step, it scores the next token (a word, word piece, or punctuation), glues the winner onto the input, and repeats.

Clear all 3 levels below:

Level 1 · Complete a Reply Pick next tokens until the loop reaches <end> (⏹).
The capital of is ?
Input length: 5 tokens

What happens when the clue is buried 13 words earlier? Why Transformers Won →