TokenTown: A Visual City Explaining How LLMs Work

TokenTown: A visual way to understand how LLMs work

I built TokenTown, an interactive isometric city where every district represents a stage of a transformer language model. As you type a prompt, a convoy carries the hidden state through tokenization, attention, and feed-forward layers, visualizing the actual math behind LLMs. While the weights are random for demonstration, the core mechanisms like KV cache and softmax are genuinely computed live in your browser to show exactly how these models generate text.