NOTES / PART 3 · RUNNING IN PRODUCTION
Changing the model itself, and when that beats prompting or RAG.
THIS SECTION COVERS
When to fine-tune, LoRA and QLoRA, supervised fine-tuning, preference tuning (RLHF, DPO), distillation, data preparation.
Related: Inference and serving · Evals and observability