#3939th of 60 in Training and fine-tuning
autotrain-advanced
No-code and YAML-driven fine-tuning for LLMs and Hugging Face models
- Stars
- 4.6k
- License
- Apache-2.0
- Last commit
- Oct 2026
- Language
- Python
Missed the latest GitHub check; these facts may be older.
Overview
AutoTrain Advanced fine-tunes models from a web UI or from a YAML config run with the `autotrain` CLI. It covers LLM SFT, ORPO, DPO and reward training, plus text and image classification, regression, token classification, seq2seq and extractive QA. The README states the project is no longer maintained and points to Axolotl, TRL or transformers.Trainer instead.
Who it is for: Teams with existing AutoTrain workflows; new work should use TRL or Axolotl
Strengths
- Covers LLM SFT, ORPO, DPO and reward training plus classification, regression, seq2seq and QA
- Same job runs from a local web UI or a YAML config on the CLI
- Config supports PEFT, int4 quantization and optional push to the Hugging Face Hub
- Runs locally, on Hugging Face Spaces, or in Colab notebooks
Weaknesses
- README states it is unmaintained: no new features and no bug fixes
- VLM task is marked as not supported in the task table
- Local install needs manual setup of torch, CUDA and git lfs
- Training data must match the required format or the project is not created
What it needs
- Docker
- Needs Python >= 3.10, PyTorch, torchaudio, torchvision, git-lfs, Hugging Face Hub token
- Models: Hugging Face Hub models, transformers, PEFT/LoRA, int4 quantization
- port 8080
Also in Training and fine-tuning
See all 60| Rank | Project | Score |
|---|---|---|
| 1 | peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models | 89 out of 100 |
| 2 | unslothDesktop and web app to run and fine-tune local models | 88 out of 100 |
| 3 | trlPost-training library with SFT, DPO, GRPO and KTO trainers | 87 out of 100 |
| #4 | deepspeedPyTorch library for distributed training of very large models with ZeRO | 86 out of 100 |
| #5 | megatron-lmDistributed training library for large transformer models on NVIDIA GPUs | 85 out of 100 |