#5252nd of 60 in Data and scraping for AI

deepke

Toolkit for extracting entities, relations and attributes to build knowledge graphs

Stars
4.5k
License
MIT
Last commit
Jul 2026
Last release
Sep 2023
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

DeepKE is a PyTorch toolkit that trains and runs models for named entity recognition, relation extraction, attribute extraction and event extraction. It covers standard, few-shot, document-level and multimodal settings, with Hydra-configured run.py and predict.py scripts per task. A separate DeepKE-LLM environment adds LLM-based extraction, and an MCP tool service is also provided.

Who it is for: Researchers and engineers building knowledge graphs from Chinese or English text

Strengths

  • Covers NER, relation, attribute and event extraction in one framework
  • Supports few-shot, document-level and multimodal settings, with Chinese and English data
  • Includes several published models (W2NER, LightNER, KnowPrompt, PRGC, PURE, ASP)
  • Provides an online demo, docs, Colab notebook and a hosted MCP service

Weaknesses

  • Pinned to Python 3.8, torch<=1.11 and transformers 4.26.0, which conflicts with newer stacks
  • Last release 2023-09-21; pip package is marked not recommended
  • Each task needs its own dataset download and config editing before training
  • Separate environment needed for DeepKE-LLM; dataset links use a bare IP over HTTP

What it needs

  • Needs PyTorch, transformers, hydra-core, wandb (optional)
  • Models: BERT-style encoders, W2NER, LightNER, KnowPrompt, PRGC

Also in Data and scraping for AI

See all 60
Also in Data and scraping for AI
RankProjectScore
1doclingPython library that converts PDFs, Office files and more into structured text70.5k stars+1,801 (+2.6%) in 30 daysMIT92 out of 100
2mineruParses PDFs, images and Office files into Markdown and structured JSON Live demo ↗ (opens in a new tab)83.6k stars+2,160 (+2.7%) in 30 dayscustom license91 out of 100
3opendataloader-pdfPDF parser that outputs Markdown, JSON with bounding boxes, and Tagged PDF30.3k stars+705 (+2.4%) in 30 daysApache-2.091 out of 100
#4agent-reachCLI that gives coding agents read access to login-gated and Chinese web platforms111.3k stars+14,960 (+16%) in 30 daysMIT89 out of 100
#5markitdownPython library and CLI that converts office files, PDFs and audio to Markdown195.1k stars+5,652 (+3.0%) in 30 daysMIT87 out of 100