#159159th of 242 in ML frameworks and libraries
optimum
Hugging Face toolkit for exporting and running models on specific accelerators
- Stars
- 3.5k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Aug 2026
- Language
- Python
3,343 on 25 Apr 20263,524 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
Optimum extends Transformers, Diffusers, TIMM and Sentence-Transformers with export, quantization and hardware-specific inference and training wrappers. It covers ONNX Runtime, OpenVINO, ExecuTorch, Intel Gaudi, AWS Inferentia/Trainium, NVIDIA TensorRT-LLM, AMD and FuriosaAI through pip extras. Export and optimization run from Python or the optimum-cli.
Who it is for: Engineers deploying Hugging Face models on specific accelerators or edge devices
Strengths
- Covers many backends: ONNX Runtime, OpenVINO, ExecuTorch, Gaudi, Inferentia, Trainium, TensorRT-LLM
- Export and optimization available both as Python API and optimum-cli
- Per-accelerator pip extras, e.g. optimum[openvino], optimum[neuronx]
- Trainer wrappers for Gaudi and Trainium alongside inference tooling
Weaknesses
- ONNX support moved to the separate optimum-onnx package, splitting docs and installs
- Much of the functionality lives in sibling repos such as optimum-intel and optimum-habana
- Library only; no model server or HTTP API included
- Each backend needs its own dependencies and hardware, so setup differs per target
What it needs
- GPU optional
- Needs Transformers, ONNX Runtime, OpenVINO, ExecuTorch, optimum-onnx
- Models: Transformers, Diffusers, TIMM, Sentence-Transformers, ONNX
What changed
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in ML frameworks and libraries
See all 242| Rank | Project | Score |
|---|---|---|
| 1 | transformersModel-definition library for pretrained text, vision, audio and multimodal models | 94 out of 100 |
| 2 | ultralyticsPython library and CLI for training and running YOLO vision models | 94 out of 100 |
| 3 | pytorch-image-modelsPyTorch library of image models, pretrained weights and training scripts | 94 out of 100 |
| #4 | pytorchPython tensor library with GPU support and tape-based autograd | 93 out of 100 |
| #5 | supervisionPython toolkit for loading, annotating and counting computer vision detections | 92 out of 100 |