#3939th of 60 in Data and scraping for AI
jionlp
Python toolkit for Chinese text cleaning, extraction and parsing
- Stars
- 3.9k
- License
- Apache-2.0
- Last commit
- Nov 2026
- Language
- Python
3,804 on 22 Apr 20263,877 on 11 Nov 2026
From GitHub's daily star counts.
Checked on GitHub.
Overview
JioNLP is a pip-installable Python library of Chinese NLP preprocessing functions. It covers regex cleaning and extraction (URLs, phone numbers, ID cards), parsing of time expressions, addresses and license plates, pinyin and traditional/simplified conversion, plus NER, classification and word-segmentation dataset helpers. Most functions are rule- and dictionary-based rather than model-based.
Who it is for: Developers preprocessing and parsing Chinese text for NLP pipelines
Strengths
- Wide set of Chinese-specific parsers: time, address, ID card, plate, phone region
- Bundled dictionaries: idioms, xiehouyu, China and world place names, Xinhua
- NER and classification dataset helpers: tag conversion, splitting, entity diffing
- Installs with a single pip command
Weaknesses
- Chinese only; no support for other languages
- Documentation lives in a GitHub wiki and the README is mostly a function table
- No tagged releases on GitHub
- Back-translation augmentation depends on third-party cloud translation APIs
What it needs
- Needs Cloud machine-translation APIs (BackTranslation only)
Also in Data and scraping for AI
See all 60| Rank | Project | Score |
|---|---|---|
| 1 | doclingPython library that converts PDFs, Office files and more into structured text | 92 out of 100 |
| 2 | mineruParses PDFs, images and Office files into Markdown and structured JSON | 91 out of 100 |
| 3 | opendataloader-pdfPDF parser that outputs Markdown, JSON with bounding boxes, and Tagged PDF | 91 out of 100 |
| #4 | agent-reachCLI that gives coding agents read access to login-gated and Chinese web platforms | 89 out of 100 |
| #5 | markitdownPython library and CLI that converts office files, PDFs and audio to Markdown | 87 out of 100 |