#2929th of 53 in Training and fine-tuningFor science, health and research, robotics

rlinf

Distributed RL training framework for robot VLA policies and LLM agents

Stars
5.6k
License
Apache-2.0
Last commit
Nov 2026
Last release
Oct 2026
Language
Python
Stars, last 29 weeks+2,519
21 Apr 2026: 3,113 stars28 Apr 2026: 3,181 stars5 May 2026: 3,213 stars12 May 2026: 3,283 stars19 May 2026: 3,369 stars26 May 2026: 3,502 stars2 Jun 2026: 3,578 stars9 Jun 2026: 3,682 stars16 Jun 2026: 3,767 stars23 Jun 2026: 3,835 stars30 Jun 2026: 3,906 stars7 Jul 2026: 3,999 stars14 Jul 2026: 4,075 stars21 Jul 2026: 4,174 stars28 Jul 2026: 4,276 stars4 Aug 2026: 4,401 stars11 Aug 2026: 4,483 stars18 Aug 2026: 4,542 stars25 Aug 2026: 4,612 stars1 Sept 2026: 4,670 stars8 Sept 2026: 4,839 stars15 Sept 2026: 5,119 stars22 Sept 2026: 5,230 stars29 Sept 2026: 5,295 stars6 Oct 2026: 5,330 stars13 Oct 2026: 5,400 stars20 Oct 2026: 5,456 stars27 Oct 2026: 5,527 stars3 Nov 2026: 5,585 stars10 Nov 2026: 5,632 stars

3,113 on 21 Apr 20265,632 on 10 Nov 2026

From GitHub's daily star counts.

Checked on GitHub.

Overview

RLinf is a Python RL training infrastructure for embodied and agentic AI. It runs PPO, GRPO, SFT, DAgger and related methods on VLA policies (OpenPI π₀/π₀.₅, GR00T, OpenVLA-OFT), world models and LLMs, in simulators such as LIBERO, RoboTwin and Isaac Lab, and on real robots. It supports several accelerator backends and Megatron-based actor training, and installs from PyPI.

Who it is for: Robotics and RL researchers post-training VLA models or LLM agents on GPUs

Strengths

  • Covers simulated and real-robot RL, including teleoperation, SFT and deployment pipeline
  • Wide model support: π₀/π₀.₅, GR00T, OpenVLA-OFT, Cosmos3, Wan2.2, Moonlight-16B
  • Eight accelerator backends, including AMD ROCm, Ascend CANN, Moore Threads and MetaX
  • Adopted by Isaac Lab v3.0.0; installable from PyPI; docs in English and Chinese

Weaknesses

  • Each model and simulator integration has its own setup; the feature set is large
  • No Docker or compose files detected in the repository
  • Aimed at robotics and RL researchers, not general LLM fine-tuning
  • Real-robot workflows depend on specific supported hardware such as Franka

What it needs

  • GPU required
  • Docker
  • Needs PyTorch, Megatron, SGLang, Simulators (LIBERO, RoboTwin, Isaac Lab)
  • Models: OpenPI π₀ / π₀.₅, π₀-FAST, OpenVLA-OFT, GR00T-N1.6/N1.7, Cosmos3

Quick answers

Is rlinf open source?

Yes. Its code is on GitHub under the Apache-2.0 license.

Can you run rlinf with Docker?

Yes. Its repository has a Docker setup: a Dockerfile, a Compose file or a published image.

Does rlinf need a GPU?

Yes, it needs a GPU.

Also in Training and fine-tuning

See all 53
Also in Training and fine-tuning
RankProjectScore
1unslothDesktop and web app to run and fine-tune local models Live demo ↗ (opens in a new tab)79.3k stars+1,694 (+2.2%) in 30 daysApache-2.088 out of 100
2peftPython library for LoRA and other parameter-efficient fine-tuning of Transformers models Live demo ↗ (opens in a new tab)21.9k stars+133 (+0.6%) in 30 daysApache-2.088 out of 100
3deepspeedPyTorch library for distributed training of very large models with ZeRO43.3k stars+166 (+0.4%) in 30 daysApache-2.086 out of 100
#4verlReinforcement learning training library for LLM post-training with PPO and GRPO24.2k stars+391 (+1.6%) in 30 daysApache-2.086 out of 100
#5trlPost-training library with SFT, DPO, GRPO and KTO trainers19.7k stars+247 (+1.3%) in 30 daysApache-2.086 out of 100