#4343rd of 100 in Learning and cookbooks

hands-on-modern-rl

Open course teaching RL from CartPole and DQN to RLHF, GRPO and agents

Stars
4.6k
License
custom license
Last commit
Oct 2026
Last release
Jun 2026
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

A bilingual (English/Chinese) online book and code collection that teaches RL in 26 chapters, from MDPs, DQN, policy gradients and PPO to DPO, GRPO, verifiable rewards, agentic RL and VLM training. It ships runnable scripts (SB3, veRL, EasyR1), 14 chapter notebooks, and ModelScope Studio companions for browser-based classic RL experiments. The authors say it was created with AI assistance and is not fully reviewed.

Who it is for: Engineers and students learning RL and LLM post-training by running code

Strengths

  • Covers classic RL through RLHF, DPO, GRPO and agentic RL in one sequence
  • Runnable examples: CartPole, Atari Pong, LunarLander, BipedalWalker, DPO, code RLVR, GeoQA
  • Online ModelScope Studios and companion notebooks allow training without local setup
  • English and Chinese editions, with PDF builds released via CI

Weaknesses

  • README says content is AI-assisted and not fully reviewed; code may not run as expected
  • Some chapters are still under construction and may contain mistakes
  • Online experiments depend on ModelScope; five need a scheduled xGPU notebook
  • Content is CC BY-NC-SA 4.0, which restricts commercial use

What it needs

  • GPU optional
  • Needs ModelScope, Stable-Baselines3, veRL, EasyR1, Gymnasium, Node >= 18 (VitePress docs)

Also in Learning and cookbooks

See all 100
Also in Learning and cookbooks
RankProjectScore
1ai-engineering-from-scratchHands-on AI engineering curriculum with 542 lessons across 20 phases78.6k stars+10,601 (+16%) in 30 daysMIT91 out of 100
2generative-ai-for-beginners21-lesson course on building generative AI apps in Python and TypeScript123.4k stars+2,358 (+1.9%) in 30 daysMIT83 out of 100
3rag_techniquesCollection of 42 runnable notebooks implementing RAG techniques30.3k stars+550 (+1.8%) in 30 dayscustom license82 out of 100
#4cs249r_bookOpen textbook and course materials for machine learning systems engineering30.2k stars+1,272 (+4.4%) in 30 dayscustom license82 out of 100
#5ai-for-beginners24-lesson AI curriculum with notebooks in PyTorch and TensorFlow Live demo ↗ (opens in a new tab)70.7k stars+1,148 (+1.6%) in 30 daysMIT81 out of 100