Glossary › Training

Backpropagation

Algorithm for computing gradients of the loss with respect to all parameters by recursively applying the chain rule through the computation graph in reverse topological order.

Where this is taught

• Backpropagation from Scratch — Phase 0: Neural Network Foundations
• Backpropagation & Training from Scratch — Phase 3: Deep Learning Core
• Calculus & Automatic Differentiation from Scratch — Phase 0: Development Environment & Mathematical Foundations
• Neural Networks from Scratch — Phase 3: Deep Learning Core
• The Perceptron — Phase 0: Neural Network Foundations
• Sampling Methods — Phase 2: Probability & Statistics

Related terms

Gradient Descent

More in Training

Batch Size · Fine-Tuning · Gradient Descent · LoRA (Low-Rank Adaptation) · RLHF · DPO (Direct Preference Optimization) · QLoRA · Learning Rate

Learn this by building

DeVenture Academy teaches AI engineering through projects — every lesson is paired with a hands-on lab you run on your own machine with real tools.

Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary