Transformer Prefill & Decode

Explore how a two-layer transformer processes a prompt during prefill and generates new tokens during decoding. Follow the tensor shapes and see how each layer’s KV cache grows as new tokens are generated.

Switch between Prefill, Decode 1, and Decode 2 to step through the walkthrough.