Figures › Transformers

KV Cache Growth During Generation

Key-value cache expanding left-to-right as tokens are generated autoregressively.

FIG_008 · Animated diagram · DeVenture Academy

Terms in this diagram

KV Cache · Token

More Transformers diagrams

Self-Attention Matrix · BPE Tokenizer: Merge Rules in Action · Transformer Block Data Flow

Learn the concept behind the diagram

This figure comes from the DeVenture Academy curriculum — project-based AI engineering courses where every lesson is paired with a hands-on lab you run on your own machine.

Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary