03 · How Models Learn
PEFT
Parameter-Efficient Fine-Tuning
Parameter-efficient fine-tuning: techniques that adapt a model by updating a small subset of weights or training small added components such as adapters. They reduce compute and storage compared with updating the full model.
Concrete example
Customizing a large model for legal documents by training a tiny fraction of it, not the whole thing.