#2626th of 36 in Gateways and observability
openllmetry
OpenTelemetry instrumentations and SDK for tracing LLM calls and vector DBs
Documentation ↗
(opens in a new tab)Website ↗
(opens in a new tab)Repository on GitHub ↗
(opens in a new tab)
- Stars
- 7.5k
- License
- Apache-2.0
- Last commit
- Oct 2026
- Last release
- Sep 2026
- Language
- Python
6,888 on 1 Apr 20267,499 on 21 Oct 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
OpenLLMetry is a set of OpenTelemetry extensions that trace calls to LLM providers, vector databases and agent frameworks. The Traceloop SDK is enabled with `Traceloop.init()` after `pip install traceloop-sdk`, and it emits standard OpenTelemetry data that can be exported to backends such as Datadog, Honeycomb, Grafana, SigNoz and Sentry. A separate repo covers JS/TS.
Who it is for: Python developers adding tracing to LLM apps on an existing OpenTelemetry setup
Strengths
- Emits standard OpenTelemetry data, so it works with an existing observability stack
- Instruments many providers, including OpenAI, Anthropic, Bedrock, Gemini, Ollama and Mistral
- Covers vector DBs (Chroma, Pinecone, Qdrant, Weaviate) and frameworks like LangChain and CrewAI
- One-line setup with the SDK; instrumentations can also be added individually
Weaknesses
- Python only in this repo; JS/TS lives in the separate OpenLLMetry-JS repo
- No bundled UI or storage; you need a separate backend to view traces
- SDK telemetry was collected in earlier versions; the README says it stops at v0.49.2 and above
- No evaluation or prompt management in this repo; the README covers tracing only
What it needs
- no GPU
- Needs OpenTelemetry-compatible backend
- Models: OpenAI, Azure OpenAI, Anthropic, AWS Bedrock, Google Gemini
Also in Gateways and observability
See all 36| Rank | Project | Score |
|---|---|---|
| 1 | LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers | 90 out of 100 |
| 2 | OmniRouteLLM gateway routing one OpenAI-compatible endpoint across 372 providers | 87 out of 100 |
| 3 | new-apiGateway that unifies LLM providers behind OpenAI, Anthropic and Gemini APIs | 83 out of 100 |
| #4 | freellmapiOpenAI-compatible router that pools free LLM provider tiers behind one endpoint | 80 out of 100 |
| #5 | LangfuseTracing, prompt management and evals for LLM apps on ClickHouse | 75 out of 100 |