#1818th of 22 in Training and fine-tuning

ludwig

YAML-configured training and fine-tuning for LLMs, multimodal and tabular models

Stars
11.8k
License
Apache-2.0
Last commit
Sep 2026
Last release
Aug 2026
Language
Python
Stars, last 29 weeks+172
31 Mar 2026: 11,603 stars7 Apr 2026: 11,609 stars14 Apr 2026: 11,616 stars21 Apr 2026: 11,622 stars28 Apr 2026: 11,631 stars5 May 2026: 11,637 stars12 May 2026: 11,650 stars19 May 2026: 11,660 stars26 May 2026: 11,669 stars2 Jun 2026: 11,680 stars9 Jun 2026: 11,686 stars16 Jun 2026: 11,690 stars23 Jun 2026: 11,695 stars30 Jun 2026: 11,699 stars7 Jul 2026: 11,704 stars14 Jul 2026: 11,709 stars21 Jul 2026: 11,716 stars28 Jul 2026: 11,719 stars4 Aug 2026: 11,724 stars11 Aug 2026: 11,728 stars18 Aug 2026: 11,731 stars25 Aug 2026: 11,734 stars1 Sept 2026: 11,739 stars8 Sept 2026: 11,744 stars15 Sept 2026: 11,751 stars22 Sept 2026: 11,759 stars29 Sept 2026: 11,766 stars6 Oct 2026: 11,769 stars13 Oct 2026: 11,773 stars20 Oct 2026: 11,775 stars

11,603 on 31 Mar 202611,775 on 20 Oct 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

Ludwig trains, fine-tunes and serves models from a YAML config and a CLI, with no training loop code. It covers LLM fine-tuning (SFT, DPO, KTO, ORPO, GRPO, LoRA and other PEFT adapters, 4-bit QLoRA, torchao QAT), plus multimodal, tabular, timeseries and image models. Runs scale from local to multi-GPU and Ray clusters by changing the backend setting.

Who it is for: ML engineers training or fine-tuning LLMs and tabular models from config

Strengths

  • Whole experiment defined in one YAML file; ludwig train, predict and serve cover the workflow
  • Wide LLM tuning coverage: SFT, DPO, KTO, ORPO, GRPO, many PEFT adapters, QLoRA
  • Mixes text, image, audio, number and timeseries inputs in one config
  • Distributed training via Accelerate (DDP, FSDP, DeepSpeed) and Ray; Optuna and Ray Tune for HPO

Weaknesses

  • Requires Python 3.12+ and recent PyTorch, Transformers and Ray versions
  • Config schema is large; advanced options need reading the docs
  • Gated base models such as Llama need a Hugging Face token
  • GPU, VRAM and RAM requirements are not stated in the README

What it needs

  • GPU optional
  • Docker
  • Needs PyTorch 2.7+, Transformers 5, Ray 2.54, Hugging Face Hub token (gated models)
  • Models: Hugging Face Transformers, LoRA, QLoRA, DoRA, VeRA
  • port 8000

Also in Training and fine-tuning

See all 22
Also in Training and fine-tuning
RankProjectScore
1unslothDesktop and web app to run, fine-tune and export open models Live demo ↗ (opens in a new tab)78.3k starsApache-2.088 out of 100
2deepspeedPyTorch library for distributed training of large models with ZeRO43.3k starsApache-2.083 out of 100
3verlReinforcement learning training library for LLM post-training with PPO and GRPO24k starsApache-2.082 out of 100
#4peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models Live demo ↗ (opens in a new tab)21.8k starsApache-2.081 out of 100
#5trlPost-training library with SFT, DPO, GRPO and KTO trainers19.6k starsApache-2.078 out of 100