#119119th of 242 in ML frameworks and libraries
litert
Google's on-device ML runtime, successor to TensorFlow Lite
- Stars
- 3.6k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Oct 2026
- Language
- C++
2,251 on 25 Apr 20263,600 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
LiteRT is a C++ runtime that runs .tflite models on Android, iOS, Linux, macOS, Windows, web and IoT targets. Its Compiled Model API selects accelerators automatically across CPU (XNNPACK), GPU (ML Drift) and vendor NPUs. It continues TensorFlow Lite, which is now in maintenance mode, and pairs with separate projects for PyTorch conversion, quantization and LLM inference (LiteRT-LM).
Who it is for: Mobile, embedded and web developers shipping on-device ML models
Strengths
- Compiled Model API picks accelerators automatically, no manual delegate setup
- NPU support from several vendors: Qualcomm, MediaTek, Google Tensor, Intel, Broadcom, S.LSI
- Covers Android, iOS, Linux, macOS, Windows and web (WebGPU/WASM via LiteRT.js)
- Conversion path from PyTorch, TensorFlow and JAX, plus a separate quantizer
Weaknesses
- Embedded runtime library, not a server; no HTTP API for serving models
- LLM inference lives in a separate repo, LiteRT-LM
- Apple Neural Engine, WebNN and Raspberry Pi NPU support are marked coming soon
- TensorFlow Lite Interpreter API is deprecated; existing code needs migration to V2
What it needs
- GPU optional
- Needs Bazel or CMake (build from source), XNNPACK
- Models: .tflite, .litertlm, PyTorch (via LiteRT Torch), TensorFlow, JAX
What changed
- v2.2.0 ↗ (opens in a new tab)Security fix
“Added integer overflow checks to convolution, reshape and pad-like CPU kernels,”
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in ML frameworks and libraries
See all 242| Rank | Project | Score |
|---|---|---|
| 1 | transformersModel-definition library for pretrained text, vision, audio and multimodal models | 94 out of 100 |
| 2 | ultralyticsPython library and CLI for training and running YOLO vision models | 94 out of 100 |
| 3 | pytorch-image-modelsPyTorch library of image models, pretrained weights and training scripts | 94 out of 100 |
| #4 | pytorchPython tensor library with GPU support and tape-based autograd | 93 out of 100 |
| #5 | supervisionPython toolkit for loading, annotating and counting computer vision detections | 92 out of 100 |