#3737th of 57 in Gateways and observability
trulens
Tracing and LLM-judge evaluation for agents and RAG apps on OpenTelemetry
- Stars
- 3.7k
- License
- MIT
- Last commit
- Nov 2026
- Last release
- Oct 2026
- Language
- Python
3,262 on 25 Apr 20263,660 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
TruLens instruments Python LLM apps with an `@instrument` decorator that records each step as an OpenTelemetry span, including latency, inputs, outputs, tokens and cost. It scores those spans with LLM-judge metrics, such as the RAG triad and seven agent evaluators, either inline as the app runs or in batch over a dataset. A leaderboard compares scores, latency and cost across app versions.
Who it is for: Engineers evaluating and debugging LLM agents and RAG apps in Python
Strengths
- Traces are OTel spans, exportable to any OTLP backend such as Jaeger or Datadog
- Seven agent evaluators, including plan adherence, tool selection and tool calling
- Runs inline or as batch evals over a dataset via the Run API
- Judge providers include OpenAI, Bedrock, Gemini, LiteLLM, HuggingFace and Snowflake Cortex
Weaknesses
- Evaluation relies on LLM judges, so most setups need an external model provider
- Python only; instrumentation is by decorator or framework package
- Each provider and app integration is a separate pip package to install
- Headline accuracy figures come from the maintainers' own papers and cited benchmarks
What it needs
- no GPU
- Needs LLM provider for judges (OpenAI, Bedrock, Gemini, LiteLLM, HuggingFace, Snowflake Cortex)
- Models: OpenAI, Azure OpenAI, LiteLLM, Google Gemini, AWS Bedrock
What changed
“Streamlit-in-Snowflake dashboard support has been removed. (#2784)”
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in Gateways and observability
See all 57| Rank | Project | Score |
|---|---|---|
| 1 | OmniRouteLLM gateway routing one OpenAI-compatible endpoint across 372 providers | 96 out of 100 |
| 2 | headroomCompresses tool outputs, logs and history before they reach the LLM | 92 out of 100 |
| 3 | new-apiGateway that unifies LLM providers behind OpenAI, Anthropic and Gemini APIs | 91 out of 100 |
| #4 | MLflowTracing, evaluation and prompt registry for LLM apps, plus ML tracking | 91 out of 100 |
| #5 | LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers | 88 out of 100 |