Glossary › Architecture

Encoder-Decoder

Two-part transformer architecture: encoder processes input into latent representations, decoder generates output autoregressively. Used in T5, BART. GPT is decoder-only.

Where this is taught

Related terms

Transformer

More in Architecture

Attention Mechanism · Transformer · RAG (Retrieval-Augmented Generation) · Mixture of Experts (MoE) · KV Cache

Learn this by building

DeVenture Academy teaches AI engineering through projects — every lesson is paired with a hands-on lab you run on your own machine with real tools.

Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary