33rd of 13 in Chat UIs
AnythingLLM
Document chat and agent app with built-in RAG, MCP and multi-user support
Documentation ↗
(opens in a new tab)Website ↗
(opens in a new tab)Repository on GitHub ↗
(opens in a new tab)
- Stars
- 67k
- License
- MIT
- Last commit
- Oct 2026
- Last release
- Oct 2026
Overview
AnythingLLM is a Node.js app that ingests PDF, TXT, DOCX and other files into a workspace and chats over them with any of 40+ LLM providers, from llama.cpp, Ollama and LM Studio to OpenAI, Anthropic, Bedrock and Gemini. It ships a native embedder, LanceDB by default plus 8 other vector stores, a no-code agent builder, MCP support, scheduled tasks, model routing and a developer API.
Who it is for: Small teams and individuals wanting private document chat without extra services
Strengths
- LanceDB embedded by default; PGVector, Qdrant, Milvus, Chroma, Weaviate, Pinecone optional
- Native embedder and audio transcription run locally with no extra service
- Multi-user instance with per-user permissions in the Docker build
- Embeddable website chat widget and a full developer API
Weaknesses
- Anonymous telemetry to PostHog is on by default; opt out with DISABLE_TELEMETRY=true
- Multi-user support and the embed widget are Docker-only, not in the desktop app
- Speech-to-text is limited to the browser built-in engine
- No root Dockerfile; container build lives under docker/
What it needs
- no GPU
- Docker + Compose
- Models: llama.cpp-compatible models, OpenAI, Azure OpenAI, AWS Bedrock, Anthropic
Head to head
Also in Chat UIs
See all 13| Rank | Project | Score |
|---|---|---|
| 1 | LobeHubAgent workspace with builder, groups, scheduling and 10,000+ MCP skills | 80 out of 100 |
| 2 | Open WebUISelf-hosted chat UI for Ollama and OpenAI-compatible APIs with RBAC and RAG | 76 out of 100 |
| #4 | big-AGIMulti-model chat workspace with Beam side-by-side model comparison | 71 out of 100 |
| #5 | Hermes WebUIBrowser UI for Hermes Agent with sessions and file browser | 69 out of 100 |
| #6 | LibreChatMulti-provider ChatGPT-style app with agents, MCP, code interpreter and auth | 66 out of 100 |