#5656th of 56 in ML frameworks and libraries

gensim

Python library for topic modelling and document similarity on large corpora

Stars
16.5k
License
LGPL-2.1
Last commit
Oct 2025
Last release
Oct 2025
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

Gensim implements streamed, out-of-core versions of LSA/LSI, LDA, Random Projections, HDP and word2vec, plus document indexing and similarity retrieval. Corpora are read through Python generators, so input can exceed RAM. Heavy computation goes through NumPy and BLAS. The project is in stable maintenance mode: bug and documentation fixes only, no new features.

Who it is for: NLP and IR practitioners doing topic modelling or similarity search

Strengths

  • Memory-independent streaming: processes corpora larger than RAM via generators
  • Multicore LSA, LDA, HDP, Random Projections and word2vec implementations
  • LSA and LDA can run distributed on a cluster of computers
  • Simple streaming and transformation APIs for custom corpora and algorithms

Weaknesses

  • Maintenance mode: no new features accepted
  • Classic topic models and word2vec only; no transformer or LLM tooling in the README
  • Speed depends on a fast BLAS; building NumPy from source is non-trivial
  • Python 2.7 support dropped after 3.8.3

What it needs

  • no GPU
  • Needs NumPy, BLAS (MKL, ATLAS or OpenBLAS recommended)
  • Models: LSA/LSI, LDA, HDP, Random Projections, word2vec

Also in ML frameworks and libraries

See all 56
Also in ML frameworks and libraries
RankProjectScore
1transformersPython library defining open models for text, vision, audio and multimodal tasks167.7k starsApache-2.095 out of 100
2pytorchPython tensor library with GPU support and tape-based autograd for deep learning104.7k starscustom license94 out of 100
3ultralyticsPython library and CLI for training and running YOLO vision models62.5k starsAGPL-3.092 out of 100
#4supervisionPython toolkit for loading, annotating and counting computer vision detections Live demo ↗ (opens in a new tab)51.2k starsMIT89 out of 100
#5pytorch-image-modelsPyTorch library of image models, pretrained weights and reference training scripts37.2k starsApache-2.089 out of 100