#peft

Articles tagged with #peft

Parameter-Efficient Fine-Tuning: From LoRA to QLoRA
Fine-tuning Large Language Models (LLMs) used to be an option only for organizations with massive compute budgets. Full fine-tuning requires updating and storing every parameter, gradient, and optimiz
Sep 16, 202610 min read17
LLM Post-Training: From Full Fine-Tuning to PEFT, Adapters, and Soft Prompts
Large Language Models (LLMs) arrive with immense foundational knowledge acquired during pre-training. However, deploying them to specialized real-world domains—such as legal document parsing, medical
Sep 8, 202614 min read5
Understanding LoRA: Parameter-Efficient Fine-Tuning for Modern LLMs
Large Language Models (LLMs) and foundation models like LLaMA, GPT, and ViTs have billions of parameters. As these models scale, traditional full fine-tuning—updating every weight in the network—becom
Aug 28, 20269 min read1