Glossary

• SFT: Supervised fine-tuning.
• PT: Pretraining.
• LoRA: Low-Rank Adaptation (adapter-based fine-tuning).
• QLoRA: Quantized base weights + LoRA adapters.
• ZeRO: Optimizations that shard optimizer state / gradients / weights across GPUs.

---

Back

• Back to docs index