Transformer
Explore illustrated attention connections across three sentences. Change the query and see how a single word can change a pronoun’s intended reference.
0/3 discoveries
Who is “it”?
Select “it” and inspect the highlighted connection.
Take the model apart.
Click a piece. See its job in slow motion.
Preparing your experiment
Loading the model and its controls…
Made for curious minds.
Explore transformers and attention with an interactive model running in your browser.
Find your next experiment →