Editing Openai/6939b23e-87cc-8001-bdd9-9546d1143ce9 (section)

==== When I said “robots,” here’s what I meant, now clarified: ====
* Neurons = little workers / robots - Each worker does a small calculation on its piece of information (token vector).
* Attention heads = spotlights - These spotlights tell the workers which other tokens to pay attention to at that layer.
* Layers = floors of a building - Information is passed floor by floor, being transformed by workers and guided by spotlights.
* The point: tokens aren’t just nodes, they’re dynamic “packages of information” traveling through a building, being processed, weighted, and re-combined at each floor.