Back to Playgrounds
advanced8-12 min
Transformer Visualizer: See Attention Light Up
Watch a transformer attend across tokens. See attention weights light up token by token, the mechanism behind modern language models.
Thinking... this might take a while, we're idiots
All computation runs in your browser. No frameworks, no GPU, just the raw math behind transformers and attention.