Lesson60 seconds
What is Attention?
How a model decides which words matter most for the next word.
Step 1 of 9
Simple Definition
Attention is a mechanism that lets a model assign importance weights across tokens in a sequence when computing representations.
Explanation level
Tap a persona to hear the same idea in a totally different voice.
Try “Like I'm 5™” for a picture-book version - not the grown-up wording above.
Notebook
Your notes
Notes save automatically on this device
Knowledge graph
Done Here Next