Glossary › Architecture
Two-part transformer architecture: encoder processes input into latent representations, decoder generates output autoregressively. Used in T5, BART. GPT is decoder-only.
Attention Mechanism · Transformer · RAG (Retrieval-Augmented Generation) · Mixture of Experts (MoE) · KV Cache
DeVenture Academy teaches AI engineering through projects — every lesson is paired with a hands-on lab you run on your own machine with real tools.
Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.
All courses · Pricing · About · FAQ · Glossary