03 · How Models Learn
QLoRA
Quantized Low-Rank Adaptation
LoRA applied to a quantized (compressed) model, making fine-tuning cheap enough for a single consumer GPU. A big reason hobbyists can fine-tune large models at home.
Concrete example
Tuning a multi-billion-parameter model on a gaming graphics card in an afternoon.