#1313th of 14 in Open models

qwen

First-generation Qwen open-weight LLMs, 1.8B to 72B, with inference and finetuning code

Stars
21.9k
License
Apache-2.0
Last commit
Mar 2026
Language
Python

Missed the latest GitHub check; these facts may be older.

Overview

Repository for the original Qwen base and chat models at 1.8B, 7B, 14B and 72B, with Int4 and Int8 quantized chat variants on Hugging Face and ModelScope. It includes Transformers inference examples, LoRA and Q-LoRA finetuning, vLLM and FastChat deployment, and a web demo. The repo is no longer actively maintained; development moved to QwenLM/Qwen2.

Who it is for: Engineers needing legacy Qwen-1 weights or reference finetuning code

Strengths

  • Four sizes (1.8B, 7B, 14B, 72B) with base, chat, Int4 and Int8 checkpoints
  • Context up to 32K on 1.8B, 7B and 72B; Q-LoRA finetune of 1.8B needs 5.8GB
  • Includes finetuning scripts: full-parameter, LoRA and Q-LoRA
  • Chat models support tool use, agent and code interpreter modes

Weaknesses

  • No longer actively maintained; README points to QwenLM/Qwen2
  • Requires trust_remote_code=True to load models
  • Qwen-14B context is 8K; Qwen-72B Int4 generation needs 48.9GB GPU memory
  • No tagged releases; README says RLHF chat models not released yet

What it needs

  • GPU optional
  • Docker
  • Needs PyTorch, Transformers, flash-attention (optional), vLLM (optional), FastChat (optional)
  • Models: Qwen-1.8B, Qwen-7B, Qwen-14B, Qwen-72B, Qwen-Chat

Also in Open models

See all 14
Also in Open models
RankProjectScore
1llmfitRust tool that checks which LLMs fit your RAM, CPU and GPU37.9k starsMIT84 out of 100
2layaSingle-pass multilingual classifier for typed choice, score and yes/no decisions Live demo ↗ (opens in a new tab)32.9k starsApache-2.079 out of 100
3timesfmPretrained time-series foundation model for zero-shot forecasting from Google Research34.5k starsApache-2.072 out of 100
#4unlimited-ocrOCR model that parses long documents and multi-page PDFs in one pass Live demo ↗ (opens in a new tab)27.3k starsMIT62 out of 100
#5insightfaceFace detection, recognition and alignment toolbox with ArcFace and RetinaFace models Live demo ↗ (opens in a new tab)29.9k starsno license57 out of 100