Glossary › Training
Quantized LoRA: fine-tunes in 4-bit precision with LoRA adapters on top. Enables fine-tuning of 70B models on a single 24GB GPU. NF4 quantization + double quantization + paged attention.
LoRA · Quantization · Fine-Tuning
Backpropagation · Batch Size · Fine-Tuning · Gradient Descent · LoRA (Low-Rank Adaptation) · RLHF · DPO (Direct Preference Optimization) · Learning Rate
DeVenture Academy teaches AI engineering through projects — every lesson is paired with a hands-on lab you run on your own machine with real tools.
Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.
All courses · Pricing · About · FAQ · Glossary