#5656th of 56 in ML frameworks and libraries
gensim
Python library for topic modelling and document similarity on large corpora
Documentation ↗
(opens in a new tab)Website ↗
(opens in a new tab)Repository on GitHub ↗
(opens in a new tab)
- Stars
- 16.5k
- License
- LGPL-2.1
- Last commit
- Oct 2025
- Last release
- Oct 2025
- Language
- Python
Missed the latest GitHub check; these facts may be older.
Overview
Gensim implements streamed, out-of-core versions of LSA/LSI, LDA, Random Projections, HDP and word2vec, plus document indexing and similarity retrieval. Corpora are read through Python generators, so input can exceed RAM. Heavy computation goes through NumPy and BLAS. The project is in stable maintenance mode: bug and documentation fixes only, no new features.
Who it is for: NLP and IR practitioners doing topic modelling or similarity search
Strengths
- Memory-independent streaming: processes corpora larger than RAM via generators
- Multicore LSA, LDA, HDP, Random Projections and word2vec implementations
- LSA and LDA can run distributed on a cluster of computers
- Simple streaming and transformation APIs for custom corpora and algorithms
Weaknesses
- Maintenance mode: no new features accepted
- Classic topic models and word2vec only; no transformer or LLM tooling in the README
- Speed depends on a fast BLAS; building NumPy from source is non-trivial
- Python 2.7 support dropped after 3.8.3
What it needs
- no GPU
- Needs NumPy, BLAS (MKL, ATLAS or OpenBLAS recommended)
- Models: LSA/LSI, LDA, HDP, Random Projections, word2vec
Also in ML frameworks and libraries
See all 56| Rank | Project | Score |
|---|---|---|
| 1 | transformersPython library defining open models for text, vision, audio and multimodal tasks | 95 out of 100 |
| 2 | pytorchPython tensor library with GPU support and tape-based autograd for deep learning | 94 out of 100 |
| 3 | ultralyticsPython library and CLI for training and running YOLO vision models | 92 out of 100 |
| #4 | supervisionPython toolkit for loading, annotating and counting computer vision detections | 89 out of 100 |
| #5 | pytorch-image-modelsPyTorch library of image models, pretrained weights and reference training scripts | 89 out of 100 |