#1313th of 14 in Open models
qwen
First-generation Qwen open-weight LLMs, 1.8B to 72B, with inference and finetuning code
Live demo ↗
(opens in a new tab)Documentation ↗
(opens in a new tab)Repository on GitHub ↗
(opens in a new tab)
- Stars
- 21.9k
- License
- Apache-2.0
- Last commit
- Mar 2026
- Language
- Python
Missed the latest GitHub check; these facts may be older.
Overview
Repository for the original Qwen base and chat models at 1.8B, 7B, 14B and 72B, with Int4 and Int8 quantized chat variants on Hugging Face and ModelScope. It includes Transformers inference examples, LoRA and Q-LoRA finetuning, vLLM and FastChat deployment, and a web demo. The repo is no longer actively maintained; development moved to QwenLM/Qwen2.
Who it is for: Engineers needing legacy Qwen-1 weights or reference finetuning code
Strengths
- Four sizes (1.8B, 7B, 14B, 72B) with base, chat, Int4 and Int8 checkpoints
- Context up to 32K on 1.8B, 7B and 72B; Q-LoRA finetune of 1.8B needs 5.8GB
- Includes finetuning scripts: full-parameter, LoRA and Q-LoRA
- Chat models support tool use, agent and code interpreter modes
Weaknesses
- No longer actively maintained; README points to QwenLM/Qwen2
- Requires trust_remote_code=True to load models
- Qwen-14B context is 8K; Qwen-72B Int4 generation needs 48.9GB GPU memory
- No tagged releases; README says RLHF chat models not released yet
What it needs
- GPU optional
- Docker
- Needs PyTorch, Transformers, flash-attention (optional), vLLM (optional), FastChat (optional)
- Models: Qwen-1.8B, Qwen-7B, Qwen-14B, Qwen-72B, Qwen-Chat
Also in Open models
See all 14| Rank | Project | Score |
|---|---|---|
| 1 | llmfitRust tool that checks which LLMs fit your RAM, CPU and GPU | 84 out of 100 |
| 2 | layaSingle-pass multilingual classifier for typed choice, score and yes/no decisions | 79 out of 100 |
| 3 | timesfmPretrained time-series foundation model for zero-shot forecasting from Google Research | 72 out of 100 |
| #4 | unlimited-ocrOCR model that parses long documents and multi-page PDFs in one pass | 62 out of 100 |
| #5 | insightfaceFace detection, recognition and alignment toolbox with ArcFace and RetinaFace models | 57 out of 100 |