Topic

LoRA, QLoRA & Parameter-Efficient Fine-Tuning

7 posts on lora, qlora & parameter-efficient fine-tuning — part of glossary on the n4n AI blog.

What is PEFT? Parameter-efficient fine-tuning explained

PEFT explained for engineers — what it is, how LoRA and QLoRA work, when to use each, and the trade-offs you'll hit in production.

July 28, 20267 min read

GlossaryDefinition

What is LoRA? Low-rank adaptation explained

LoRA (Low-Rank Adaptation) explained for engineers — how it works, why it matters for fine-tuning LLMs, and a concrete PyTorch example.

July 28, 20266 min read

GlossaryDefinition

QLoRA explained: fine-tuning in 4-bit precision

QLoRA combines 4-bit quantization with LoRA adapters to fine-tune large language models on consumer GPUs without quality loss.

July 28, 20266 min read

GlossaryComparison

LoRA vs QLoRA: what's the difference?

A practitioner's head-to-head comparison of LoRA and QLoRA across memory, compute, quality, and tooling — with a clear verdict for each use case.

July 28, 20266 min read

GlossaryComparison

LoRA vs full fine-tuning: costs and tradeoffs

A practical head-to-head comparison of LoRA and full fine-tuning across cost, performance, and operational tradeoffs for engineers choosing a fine-tuning strategy.

July 28, 20265 min read

GlossaryHow-to

How LoRA fine-tuning works, step by step

A practical step-by-step guide to LoRA fine-tuning with runnable code, covering setup, training, and verification for engineers building with LLMs.

July 28, 20264 min read

GlossaryTutorial

Fine-tuning Llama 3 with LoRA: what you need to know

A hands-on tutorial for fine-tuning Llama 3 with LoRA, covering prerequisites, dataset prep, training loops, and evaluation with runnable code.

July 28, 20263 min read