#3232nd of 88 in Learning and cookbooks
ai-infra-book
A quantitative book on AI infrastructure design, with calculation tools
- Stars
- 7.5k
- License
- Apache-2.0
- Last commit
- Oct 2026
- Last release
- Oct 2026
- Language
- Python
17 on 18 Aug 20267,490 on 10 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
This repository holds an open-source book (Chinese original, plus English, Traditional Chinese and Russian translations) deriving AI infrastructure design from hardware constraints: memory, compute and bandwidth across model architectures, accelerators, networking, inference and training. It ships a Python CLI to recompute the book's quantitative examples for a chosen model and token count, plus chapter-indexed experiments, some needing GPUs. Static calculations need only Python 3.10+ stdlib.
Who it is for: Engineers and researchers building LLM inference/training systems and infra
Strengths
- Companion CLI lets readers recompute every quantitative example with their own model and hardware
- Static calculations need only Python 3.10+ stdlib, no GPU or model weights
- Covers the full inference/training stack: accelerators, networks, superpods, scheduling, edge-cloud
- Available in four languages with auto-published PDF and EPUB per release
Weaknesses
- Manuscript is explicitly a draft still under revision
- Experiments directory needs GPUs and large Git LFS downloads (~20GB) for full reproduction
- Primarily a book/learning resource, not a deployable tool or service
- PDF build requires Pandoc, XeLaTeX and fonts, no Docker setup provided
What it needs
- GPU optional
- Needs Git LFS, Pandoc, XeLaTeX
- Models: Qwen3-8B
- port 8000
Quick answers
Is ai-infra-book open source?
Yes. Its code is on GitHub under the Apache-2.0 license.
Does ai-infra-book need a GPU?
No. It runs on a CPU and can use a GPU when you have one.
Also in Learning and cookbooks
See all 88| Rank | Project | Score |
|---|---|---|
| 1 | ai-engineering-from-scratchHands-on AI engineering curriculum with 542 lessons across 20 phases | 91 out of 100 |
| 2 | generative-ai-for-beginners21-lesson course on building generative AI apps in Python and TypeScript | 83 out of 100 |
| 3 | rag_techniquesCollection of 42 runnable notebooks implementing RAG techniques | 81 out of 100 |
| #4 | cs249r_bookOpen textbook and course materials for machine learning systems engineering | 81 out of 100 |
| #5 | ai-for-beginners24-lesson AI curriculum with notebooks in PyTorch and TensorFlow | 80 out of 100 |