#118118th of 242 in ML frameworks and libraries
iree
MLIR-based compiler and runtime for deploying ML models from datacenter to edge
- Stars
- 4k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- C++
3,699 on 25 Apr 20264,019 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
IREE compiles machine learning models to a unified MLIR-based IR and executes them with a runtime, targeting hardware from datacenter systems to mobile and edge devices. It is distributed as the PyPI packages iree-base-compiler and iree-base-runtime, and can be built from source. User guides and build instructions are on iree.dev.
Who it is for: Compiler and ML systems engineers deploying models to varied hardware
Strengths
- One compiler and runtime path covering datacenter through mobile and edge targets
- Installable from PyPI as iree-base-compiler and iree-base-runtime
- Nightly CI on Linux arm64 and macOS arm64
- AMD submitted an IREE-based SDXL implementation to MLPerf inference
Weaknesses
- Compiler toolchain, not a ready-to-use model server or chat app
- Extending or debugging it requires MLIR and compiler knowledge
- README lists no supported model formats or hardware backends
- Source builds need a C++ toolchain; no Docker setup provided
What it needs
- GPU optional
What changed
- v3.14.0 ↗ (opens in a new tab)Breaking
“ireelinalgext.sort takes its inputs as ins(). The op used to sort its outs() operands in place. Inputs now go in ins() and destination tensors in outs(), like other LinalgExt ops. Update hand-written…”
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in ML frameworks and libraries
See all 242| Rank | Project | Score |
|---|---|---|
| 1 | transformersModel-definition library for pretrained text, vision, audio and multimodal models | 94 out of 100 |
| 2 | ultralyticsPython library and CLI for training and running YOLO vision models | 94 out of 100 |
| 3 | pytorch-image-modelsPyTorch library of image models, pretrained weights and training scripts | 94 out of 100 |
| #4 | pytorchPython tensor library with GPU support and tape-based autograd | 93 out of 100 |
| #5 | supervisionPython toolkit for loading, annotating and counting computer vision detections | 92 out of 100 |