#107107th of 153 in Agent frameworks and SDKs
lazyllm
Python framework for building multi-agent and RAG apps with local or hosted models
- Stars
- 3.9k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- Python
3,763 on 25 Apr 20263,890 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
LazyLLM is a Python library for assembling multi-agent LLM applications from modules (TrainableModule, OnlineChatModule, ServerModule, WebModule) and flows such as pipeline, parallel, switch and loop. It wraps local inference (lightllm, vllm), fine-tuning (collie, peft) and online providers behind one interface, and includes RAG components: Document, Retriever, Reranker. A built-in WebModule serves a chat UI, and launchers target bare metal, Slurm and SenseCore.
Who it is for: Python developers building multi-agent or RAG apps on local or hosted models
Strengths
- Same code path for local models and online providers such as OpenAI, Kimi, Zhipu, Qwen
- Flow primitives (pipeline, parallel, diverter, loop, switch) compose RAG and agent graphs briefly
- Fine-tuning and inference frameworks share one API, with automatic framework selection
- CLI shortcuts `lazyllm run chatbot` and `lazyllm run rag` start a working app
Weaknesses
- Local inference limited to lightllm and vllm; fine-tuning limited to collie and peft
- Online fine-tuning only for GPT, SenseNova and Tongyi Qianwen
- No Dockerfile or compose file detected; image packaging is described but not shipped
- Built-in components and examples lean toward Chinese models and providers
What it needs
- GPU optional
- Needs lightllm or vllm (local inference), collie or peft (fine-tuning), online provider API key (e.g. OpenAI)
- Models: internlm2-chat-7b, OpenAI, SenseNova, Kimi, Zhipu GLM
What changed
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in Agent frameworks and SDKs
See all 153| Rank | Project | Score |
|---|---|---|
| 1 | ppt-masterAgent skill that turns documents into natively editable PowerPoint decks | 96 out of 100 |
| 2 | copilotkitReact and Angular SDK for adding agent chat and generative UI to apps | 92 out of 100 |
| 3 | openai-agents-pythonPython SDK for multi-agent workflows with handoffs, guardrails and tracing | 92 out of 100 |
| #4 | mastraTypeScript framework for building AI agents, workflows and MCP servers | 92 out of 100 |
| #5 | browser-usePython library that lets an LLM agent control a web browser | 90 out of 100 |