11st of 7 in ML frameworks and libraries

transformers

Model-definition library for text, vision, audio and multimodal models

Stars
167.6k
License
Apache-2.0
Last commit
Oct 2026
Last release
Oct 2026
Language
Python

Checked on GitHub.

Overview

Transformers is a Python library that defines model architectures for text, vision, audio, video and multimodal models and loads pretrained checkpoints from the Hugging Face Hub. It offers a Pipeline API for inference, a PyTorch-based training API, and `transformers serve` and `transformers chat` commands. Other training frameworks and inference engines reuse its model definitions.

Who it is for: Python developers and researchers running or training pretrained models

Strengths

  • Hundreds of architectures and 1M+ Hub checkpoints behind one unified API
  • Pipeline API covers text, audio, vision and multimodal tasks in a few lines
  • Definitions are reused by Axolotl, Unsloth, DeepSpeed, vLLM, SGLang, TGI and others
  • Model files are deliberately flat and usable independently of the library

Weaknesses

  • Not a modular toolbox of neural net building blocks, per the README
  • Training API targets Transformers' PyTorch models; generic loops should use Accelerate
  • Example scripts are only examples and may need adapting
  • Requires Python 3.10+ and PyTorch 2.6+; RAM and GPU needs are not stated

What it needs

  • GPU optional
  • Docker
  • Needs Python 3.10+, PyTorch 2.6+, Hugging Face Hub
  • Models: PyTorch, Hugging Face Hub checkpoints, text, vision, audio

Head to head

Also in ML frameworks and libraries

See all 7
Also in ML frameworks and libraries
RankProjectScore
2pytorchPython tensor library with GPU support and tape-based autograd for deep learning104.8k starscustom license89 out of 100
3tensorflowTensor and neural network framework with Python and C++ APIs200.9k starsApache-2.080 out of 100
#4ultralyticsPython library and CLI for training and running YOLO vision models62.5k starsAGPL-3.077 out of 100
#5kerasMulti-backend deep learning library running on JAX, TensorFlow and PyTorch64.4k starsApache-2.070 out of 100
#6scikit-learnPython library of classical machine learning algorithms built on NumPy and SciPy67.6k starsBSD-3-Clause69 out of 100