#4545th of 67 in RAG, knowledge and search
pyserini
Python toolkit for reproducible sparse and dense retrieval research
- Stars
- 2.2k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Last release
- Aug 2026
- Language
- Python
2,044 on 25 Apr 20262,216 on 14 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
Pyserini is a Python toolkit for first-stage retrieval in IR research. It wraps Anserini (Lucene) for BM25 and learned sparse models such as uniCOIL and SPLADE, and Faiss for dense models such as DPR, Contriever and BGE, with hybrid fusion. It ships prebuilt indexes, queries, relevance judgments and evaluation scripts for MS MARCO, BEIR and other collections, and offers a REST API and an MCP server.
Who it is for: IR researchers and engineers building or benchmarking retrieval pipelines
Strengths
- Prebuilt indexes and two-click reproductions for MS MARCO, BEIR, BRIGHT, MIRACL and more
- BM25, learned sparse, dense and hybrid retrieval behind one Python API
- Can index your own corpus as BM25, sparse vector or dense vector indexes
- Ships a REST API and MCP server, plus Index Reader, Analyzer and Query Builder APIs
Weaknesses
- Needs Java 21 and Python 3.12, with PyTorch and Faiss installed separately
- Research-oriented first-stage retrieval; no built-in answer generation or chat UI
- README notes dependency version mismatches as a source of install problems
- Some prebuilt corpora are large, up to 72 GB for MS MARCO V2 doc uniCOIL
What it needs
- GPU optional
- Needs Java 21, Anserini (Lucene 10.5.0), Faiss, PyTorch
- Models: BM25, uniCOIL, SPLADE, DPR, Contriever
What changed
From the release notes. No flag means the note does not say so, not that the upgrade is safe.
Also in RAG, knowledge and search
See all 67| Rank | Project | Score |
|---|---|---|
| 1 | Open NotebookSelf-hosted NotebookLM alternative for research notebooks, chat, and podcasts | 92 out of 100 |
| 2 | LightRAGGraph-based RAG framework with a REST server and WebUI | 92 out of 100 |
| 3 | RAGFlowRAG engine with document parsing, agentic retrieval and citations | 90 out of 100 |
| #4 | deeptutorTutoring workspace with knowledge bases, guided learning, memory and quizzes | 90 out of 100 |
| #5 | MaxKBEnterprise knowledge-base agent platform with RAG, workflows and MCP tools | 89 out of 100 |