ludwig

From the README

pip install ludwig           # core
pip install ludwig[full]     # all optional dependencies
pip install ludwig[llm]      # LLM fine-tuning only

• Supervised fine-tuning (SFT) on instruction/response pairs
• Alignment training: DPO, KTO, ORPO, GRPO (reward-model-free RLHF)
• PEFT adapters: LoRA, DoRA, VeRA, LoRA+, TinyLoRA, OFT, HRA, WaveFT, LN-Tuning, VBLoRA, C3A
• LoRA initializers: PiSSA, EVA, CorDA, LoftQ for improved convergence
• Multi-adapter PEFT: multiple named adapters on one base model, switchable at runtime; merge with TIES, DARE, SVD, magnitude pruning
• Quantization: 4-bit/8-bit QLoRA (bitsandbytes), torchao int4/int8/float8 with QAT

Excerpts from the project README on GitHub. Copyright and licensing remain with the respective authors.