Glossary › Training

LoRA (Low-Rank Adaptation)

Parameter-efficient fine-tuning that freezes base weights and trains small rank-decomposition matrices (A, B). Reduces trainable params by 99%+. Rank 8-64 typical. Merged for inference.

Where this is taught

• Hands-On LoRA Fine-tuning — Phase 4: Transformers & LLM Foundations
• LoRA Fine-Tuning for Brand Consistency — Phase 2: Image Generation
• Pretraining, Fine-tuning & LoRA — Phase 4: Transformers & LLM Foundations
• ControlNet, LoRA & Conditioning — Phase 1: Generative Adversarial Networks
• Conditioning & Model File Formats — Phase 1: Diffusion Model Fundamentals
• Parameter Patching — Phase 6: ComfyUI — Workflow Engine

Related terms

Fine-Tuning · QLoRA

More in Training

Backpropagation · Batch Size · Fine-Tuning · Gradient Descent · RLHF · DPO (Direct Preference Optimization) · QLoRA · Learning Rate

Learn this by building

DeVenture Academy teaches AI engineering through projects — every lesson is paired with a hands-on lab you run on your own machine with real tools.

Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary