#7070th of 153 in Agent frameworks and SDKs
semantic-router
Python library that routes queries to predefined routes by embedding similarity
- Stars
- 4k
- License
- MIT
- Last commit
- Nov 2026
- Last release
- Nov 2026
- Language
- Python
3,443 on 25 Apr 20264,039 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
Semantic Router is a Python library that decides which predefined route a user message belongs to by comparing embeddings of example utterances, instead of waiting on an LLM generation. Routers can be calibrated with labelled queries so the confidence threshold acts as a probability and can return no match. The 1.x line also adds a DecisionRouter backed by small decision models, plus Chain and Merge for combining routers.
Who it is for: Python developers adding fast intent routing or guardrails to LLM apps
Strengths
- Runs fully locally with FastEmbed, no API keys needed
- Calibration via fit() turns scores into probabilities and allows a none-of-these result
- Swappable encoders (OpenAI, Cohere, Hugging Face) and indexes (Pinecone, Qdrant, Postgres)
- Supports hybrid sparse search, image routing, and saving routers to YAML or JSON
Weaknesses
- 1.x changes the API from 0.x; 0.x gets bug fixes only and needs migration
- Routing quality depends on hand-written example utterances and labelled calibration data
- DecisionRouter relies on TypeSafe's Jev, Laya or Von models, not general LLMs
- Only decides which route applies; tool execution and agent logic are left to you
What it needs
- Compose
- Needs Pinecone (optional), Qdrant (optional), Postgres (optional)
- Models: FastEmbed (BAAI/bge-small-en-v1.5), OpenAI embeddings, Cohere embeddings, Hugging Face encoders, TypeSafe Jev, Laya, Von decision models
What changed
- v1.1.1 ↗ (opens in a new tab)Security fix
GHSA-6Q48-6C7W-9GW2. “LiteLLM 1.107.0 is excluded. That PyPI release contained malware (a supply-chain attack, live on PyPI on 21 October 2026 from 11:39 to 13:23 UTC), and the litellm extra allowed it. The extra is now l…”
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in Agent frameworks and SDKs
See all 153| Rank | Project | Score |
|---|---|---|
| 1 | ppt-masterAgent skill that turns documents into natively editable PowerPoint decks | 96 out of 100 |
| 2 | copilotkitReact and Angular SDK for adding agent chat and generative UI to apps | 92 out of 100 |
| 3 | openai-agents-pythonPython SDK for multi-agent workflows with handoffs, guardrails and tracing | 92 out of 100 |
| #4 | mastraTypeScript framework for building AI agents, workflows and MCP servers | 92 out of 100 |
| #5 | browser-usePython library that lets an LLM agent control a web browser | 90 out of 100 |