#108108th of 242 in ML frameworks and libraries
onednn
Optimized CPU and GPU deep learning primitives library used inside PyTorch and TensorFlow
- Stars
- 4.1k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- C++
3,957 on 25 Apr 20264,094 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
oneDNN is a C++ library of optimized deep learning operations such as matmul, convolution, attention and normalization for x86-64, AArch64, RISC-V CPUs and Intel GPUs. It detects the ISA at runtime and JIT-generates specialized kernels, with post-op fusion and a Graph API for patterns like SDPA and GQA. The README says most practitioners should use it through a framework (PyTorch, ONNX Runtime, llama.cpp, others) rather than directly.
Who it is for: Framework and runtime developers needing fast CPU/GPU kernels
Strengths
- Runtime ISA detection with JIT kernels for Intel 64/AMD64, AArch64 and RV64 CPUs
- Data types from f32 down to f4 and s4, including OCP microscaling formats
- Graph API fuses larger patterns such as SDPA and GQA; post-ops fuse into matmul and convolution
- Integrated in PyTorch, TensorFlow, ONNX Runtime, OpenVINO, llama.cpp and others
Weaknesses
- Low-level C/C++ API; README advises most users to go through a framework instead
- NVIDIA and AMD GPU backends are experimental; PPC64 and s390x have limited validation
- GPU engine is off by default and needs a vendor-specific SYCL or OpenCL toolchain
- Optimized GPU targets listed are Intel only; other vendors are experimental
What it needs
- GPU optional
- Needs CMake 3.13+, C++11 compiler, OpenMP or TBB (CPU runtime), SYCL/OpenCL/Level Zero (GPU), Arm Compute Library (optional, AArch64)
- Models: f32, bf16, f16, f8, f4
What changed
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in ML frameworks and libraries
See all 242| Rank | Project | Score |
|---|---|---|
| 1 | transformersModel-definition library for pretrained text, vision, audio and multimodal models | 94 out of 100 |
| 2 | ultralyticsPython library and CLI for training and running YOLO vision models | 94 out of 100 |
| 3 | pytorch-image-modelsPyTorch library of image models, pretrained weights and training scripts | 94 out of 100 |
| #4 | pytorchPython tensor library with GPU support and tape-based autograd | 93 out of 100 |
| #5 | supervisionPython toolkit for loading, annotating and counting computer vision detections | 92 out of 100 |