#5757th of 57 in Gateways and observability
deepchecks
Python checks for validating tabular, NLP and vision data and models
- Stars
- 4.1k
- License
- custom license
- Last commit
- Nov 2025
- Last release
- Dec 2024
- Language
- Python
3,988 on 25 Apr 20264,069 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
Deepchecks is a Python package of built-in Checks and Suites that test data integrity, drift, leakage and model performance for tabular, NLP and computer vision projects. Results can be saved as HTML, shown in Jupyter, read as JSON or Python values, and gated with pass/fail conditions in CI. A separate repo, deepchecks/monitoring, reuses the same checks for production models.
Who it is for: ML engineers who need data and model validation tests in research and CI
Strengths
- Built-in checks for drift, leakage, conflicting labels and weak segments across three data types
- Checks take configurable parameters and conditions, and custom checks can be written
- Results export to HTML, Jupyter, JSON or Python values for CI gating
- Installs with pip or conda, with optional nlp and vision extras
Weaknesses
- AGPL 3.0 licensing may block use in some commercial products
- Managed CI and testing management is a closed preview, not open source
- Self-hosted open-source monitoring supports only one model per deployment
- Monitoring repo has a commercial-licensed ee directory; last release was Dec 2024
What it needs
- Needs Docker (self-hosted monitoring only)
- Models: Tabular, NLP, Computer vision
What changed
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in Gateways and observability
See all 57| Rank | Project | Score |
|---|---|---|
| 1 | OmniRouteLLM gateway routing one OpenAI-compatible endpoint across 372 providers | 96 out of 100 |
| 2 | headroomCompresses tool outputs, logs and history before they reach the LLM | 92 out of 100 |
| 3 | new-apiGateway that unifies LLM providers behind OpenAI, Anthropic and Gemini APIs | 91 out of 100 |
| #4 | MLflowTracing, evaluation and prompt registry for LLM apps, plus ML tracking | 91 out of 100 |
| #5 | LiteLLMOpenAI-format gateway and Python SDK for calling 100+ LLM providers | 88 out of 100 |