evidently

Overview

Evidently is a Python library with 100+ built-in metrics for tabular and text data, covering data drift, data quality, classification, regression, ranking, RAG and LLM-as-a-judge evals. Reports can be turned into pass/fail Test Suites for CI checks, and results can be exported as JSON, dict or HTML. A self-hosted monitoring UI (`evidently ui`, localhost:8000) tracks metrics over time.

Who it is for: ML and LLM engineers adding evals, drift checks and monitoring to pipelines

What it needs

• no GPU
• Docker
• Needs Python, pandas
• Models: tabular data, text, LLM-as-a-judge
• port 8000