03 · How Models Learn

QLoRA

Quantized Low-Rank Adaptation

LoRA applied to a quantized (compressed) model, making fine-tuning cheap enough for a single consumer GPU. A big reason hobbyists can fine-tune large models at home.

Concrete example

Tuning a multi-billion-parameter model on a gaming graphics card in an afternoon.