Transformer — Self-Attention in 3D
Real GPT-2 reading “The cat sat on the” · drag to orbit
Each glowing arc is real attention — a token looking at another. Depth = the model's 12 layers.
tokens
attention flow
prediction