#3939th of 60 in Training and fine-tuning

autotrain-advanced

No-code and YAML-driven fine-tuning for LLMs and Hugging Face models

Stars
4.6k
License
Apache-2.0
Last commit
Oct 2026
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

AutoTrain Advanced fine-tunes models from a web UI or from a YAML config run with the `autotrain` CLI. It covers LLM SFT, ORPO, DPO and reward training, plus text and image classification, regression, token classification, seq2seq and extractive QA. The README states the project is no longer maintained and points to Axolotl, TRL or transformers.Trainer instead.

Who it is for: Teams with existing AutoTrain workflows; new work should use TRL or Axolotl

Strengths

  • Covers LLM SFT, ORPO, DPO and reward training plus classification, regression, seq2seq and QA
  • Same job runs from a local web UI or a YAML config on the CLI
  • Config supports PEFT, int4 quantization and optional push to the Hugging Face Hub
  • Runs locally, on Hugging Face Spaces, or in Colab notebooks

Weaknesses

  • README states it is unmaintained: no new features and no bug fixes
  • VLM task is marked as not supported in the task table
  • Local install needs manual setup of torch, CUDA and git lfs
  • Training data must match the required format or the project is not created

What it needs

  • Docker
  • Needs Python >= 3.10, PyTorch, torchaudio, torchvision, git-lfs, Hugging Face Hub token
  • Models: Hugging Face Hub models, transformers, PEFT/LoRA, int4 quantization
  • port 8080

Also in Training and fine-tuning

See all 60
Also in Training and fine-tuning
RankProjectScore
1peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models Live demo ↗ (opens in a new tab)21.9k stars+133 (+0.6%) in 30 daysApache-2.089 out of 100
2unslothDesktop and web app to run and fine-tune local models Live demo ↗ (opens in a new tab)79.4k stars+1,652 (+2.1%) in 30 daysApache-2.088 out of 100
3trlPost-training library with SFT, DPO, GRPO and KTO trainers19.7k stars+250 (+1.3%) in 30 daysApache-2.087 out of 100
#4deepspeedPyTorch library for distributed training of very large models with ZeRO43.3k stars+163 (+0.4%) in 30 daysApache-2.086 out of 100
#5megatron-lmDistributed training library for large transformer models on NVIDIA GPUs18.4k starscustom license85 out of 100