#9999th of 100 in Learning and cookbooks

tiny-universe

Chinese-language tutorials building LLM, RAG and agent parts from scratch in PyTorch

Stars
5.1k
License
no license
Last commit
Feb 2026
Language
Jupyter Notebook
Stars, last 29 weeks+466
22 Apr 2026: 4,674 stars29 Apr 2026: 4,712 stars6 May 2026: 4,729 stars13 May 2026: 4,762 stars20 May 2026: 4,786 stars27 May 2026: 4,799 stars3 Jun 2026: 4,824 stars10 Jun 2026: 4,836 stars17 Jun 2026: 4,856 stars24 Jun 2026: 4,867 stars1 Jul 2026: 4,883 stars8 Jul 2026: 4,894 stars15 Jul 2026: 4,915 stars22 Jul 2026: 4,929 stars29 Jul 2026: 4,943 stars5 Aug 2026: 4,955 stars12 Aug 2026: 4,968 stars19 Aug 2026: 4,981 stars26 Aug 2026: 4,993 stars2 Sept 2026: 5,007 stars9 Sept 2026: 5,022 stars16 Sept 2026: 5,036 stars23 Sept 2026: 5,055 stars30 Sept 2026: 5,063 stars7 Oct 2026: 5,075 stars14 Oct 2026: 5,092 stars21 Oct 2026: 5,107 stars28 Oct 2026: 5,119 stars4 Nov 2026: 5,127 stars11 Nov 2026: 5,140 stars

4,674 on 22 Apr 20265,140 on 11 Nov 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

A Datawhale course of Jupyter notebooks and write-ups that rebuild LLM components at the PyTorch level without high-level frameworks. Modules cover Tiny Llama3 pretraining, a Transformer, a Qwen2 architecture walkthrough, DDPM diffusion, RAG, GraphRAG, a ReAct-style agent and an evaluation suite. The README is in Chinese, and some modules have companion lecture videos.

Who it is for: Chinese-reading ML learners who want to build LLM, RAG, agent internals

Strengths

  • Covers model, RAG, GraphRAG, agent, eval and diffusion in one repository
  • Code written in plain PyTorch and NumPy rather than wrapped frameworks
  • TinyLLM training is stated to use about 2 GB of VRAM
  • Several modules link to recorded walkthrough videos

Weaknesses

  • Documentation is written in Chinese only
  • CC BY-NC-SA 4.0 license forbids commercial use
  • Educational code, not a library or deployable system
  • No releases; each module has its own setup

What it needs

  • GPU optional
  • Needs PyTorch, NumPy
  • Models: Qwen2, Llama3 (tiny), DDPM

Also in Learning and cookbooks

See all 100
Also in Learning and cookbooks
RankProjectScore
1ai-engineering-from-scratchHands-on AI engineering curriculum with 542 lessons across 20 phases78.6k stars+10,601 (+16%) in 30 daysMIT91 out of 100
2generative-ai-for-beginners21-lesson course on building generative AI apps in Python and TypeScript123.4k stars+2,358 (+1.9%) in 30 daysMIT83 out of 100
3rag_techniquesCollection of 42 runnable notebooks implementing RAG techniques30.3k stars+550 (+1.8%) in 30 dayscustom license82 out of 100
#4cs249r_bookOpen textbook and course materials for machine learning systems engineering30.2k stars+1,272 (+4.4%) in 30 dayscustom license82 out of 100
#5ai-for-beginners24-lesson AI curriculum with notebooks in PyTorch and TensorFlow Live demo ↗ (opens in a new tab)70.7k stars+1,148 (+1.6%) in 30 daysMIT81 out of 100