#2323rd of 68 in Training and fine-tuning
marin
Python platform for training LLMs from data curation through evaluation
Documentation ↗
(opens in a new tab)Website ↗
(opens in a new tab)Repository on GitHub ↗
(opens in a new tab)
- Stars
- 4.1k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- Python
882 on 25 Apr 20264,125 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
Marin is a research program and Python framework for building foundation models: data curation, tokenization, pretraining, posttraining and evaluation. Experiments are written as dependent steps that run in topological order, like a Makefile, and scale from a tiny CPU run to GPU or TPU pods. It has produced an 8B model, a 32B model and the Delphi scaling suite.
Who it is for: Researchers and teams pretraining or posttraining LLMs on TPU or GPU clusters
Strengths
- Experiments are declared as dependent steps in Python, executed in topological order
- Scales from a CPU tutorial run to GPU or TPU pods, including multislice TPUs
- Publishes checkpoints, training scripts, mixture pipelines and retrospectives, including failed runs
- Tutorials cover a tiny TinyStories model and a DCLM 1B/1x run
Weaknesses
- Research codebase tied to the project's own experiments; not a general fine-tuning tool
- Large-scale runs need TPU or GPU clusters; no small-GPU recipe is given
- No Docker or Compose setup in the repo
- Current focus is a 500B+ MoE, so interfaces may shift with research needs
What it needs
- GPU optional
- Docker
- Needs Hugging Face datasets, Google TPU or GPU cluster for large runs
- Models: Llama-architecture LLMs, mixture-of-experts LLMs
What changed
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in Training and fine-tuning
See all 68| Rank | Project | Score |
|---|---|---|
| 1 | peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models | 89 out of 100 |
| 2 | unslothDesktop and web app to run and fine-tune local models | 88 out of 100 |
| 3 | trlPost-training library with SFT, DPO, GRPO and KTO trainers | 88 out of 100 |
| #4 | deepspeedPyTorch library for distributed training of very large models with ZeRO | 87 out of 100 |
| #5 | megatron-lmDistributed training library for large transformer models on NVIDIA GPUs | 86 out of 100 |