#174174th of 242 in ML frameworks and libraries
thunderkittens
Header-only CUDA library of tile primitives for writing fast GPU kernels
- Stars
- 3.8k
- License
- MIT
- Last commit
- Sep 2026
- Language
- Cuda
3,309 on 25 Apr 20263,804 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
ThunderKittens is a header-only C++/CUDA library that provides register and shared-memory tile and vector types, plus operations on them, for writing deep learning kernels. It wraps tensor core calls (WGMMA on H100, TCGEN05 on B200), TMA loads and stores, and NVLink transfers. The repo includes pre-implemented kernels (GEMM, attention) with per-kernel Makefiles and PyTorch bindings, and demos for LLM training and inference.
Who it is for: CUDA engineers writing custom kernels for Hopper and Blackwell GPUs
Strengths
- Header-only: clone and include kittens.cuh, no install step
- Covers Hopper and Blackwell features: WGMMA, TCGEN05, TMA, MXFP8, NVFP4
- Compile-time layout checks catch invalid tile operations early
- Example H100 GEMM in under 100 lines reaches about 855 TFLOPs (86% of peak)
Weaknesses
- NVIDIA only; AMD GPUs need the separate HipKittens project
- Ampere no longer actively supported
- Requires CUDA 12.8+ and C++20; older gcc causes compile errors
- No top-level Python package since 2.0; each kernel is built separately with make
What it needs
- GPU required
- Needs CUDA 12.8+, C++20 compiler (gcc 11+), PyTorch 2.8+ and PyBind11 for bundled kernels
Also in ML frameworks and libraries
See all 242| Rank | Project | Score |
|---|---|---|
| 1 | transformersModel-definition library for pretrained text, vision, audio and multimodal models | 94 out of 100 |
| 2 | ultralyticsPython library and CLI for training and running YOLO vision models | 94 out of 100 |
| 3 | pytorch-image-modelsPyTorch library of image models, pretrained weights and training scripts | 94 out of 100 |
| #4 | pytorchPython tensor library with GPU support and tape-based autograd | 93 out of 100 |
| #5 | supervisionPython toolkit for loading, annotating and counting computer vision detections | 92 out of 100 |