llmrun

Qwen Models — Hardware Requirements

28 Qwen models from Alibaba and the community, from the smallest that runs in 1.6 GB of VRAM at Q4 up to 111.2B parameters. Every row links to full quantization tables and GPU compatibility.

All Qwen Models by Size

ModelParamsContext
Qwen1.5 0.5B Chat620M33K
Qwen1.5 0.5B620M33K
Qwen Base Invoicev1.01 1.5B1.5B33K
Qwen1.5 1.8B Chat1.8B33K
Qwen 1 8B1.8B8K
Qwen1.5 1.8B1.8B33K
Qwen1.5 4B4.0B33K
CodeQwen1.5 7B7.3B66K
Qwen 7B Chat7.7B33K
Qwen1.5 7B7.7B33K
Qwen1.5 7B Chat7.7B33K
Qwen 7B7.7B33K
Qwen Image 2.1 PE T2I9.4B262K
Qwen 14B Chat14.2B8K
Qwen1.5 14B Chat14.2B33K
Qwen 14B14.2B8K
Qwen1.5 14B14.2B33K
Qwen1.5 MoE A2.7B14.3B8K
Qwen1.5 MoE A2.7B Chat14.3B33K
Qwen1.5 32B32.5B33K
Qwen1.5 32B Chat32.5B33K
Qwen AgentWorld 35B A3B34.7B262K
Qwen 72B72.3B33K
Qwen1.5 72B Chat72.3B33K
Qwen1.5 110B Chat111.2B33K
Qwen1.5 110B111.2B33K
Community variants and fine-tunes(11)
ModelParamsContext
SpatialLM1.1 Qwen 0.5B604M33K
Nemotron Research Reasoning Qwen 1.5B1.8B131K
Qwen35 4B Soyuz Merged4B262K
CyberSecQwen 4B4.0B262K
ELYZA Shortcut 1.0 Qwen 7B7.6B33K
Qwen Marketing8.2B—
Qwen27b Abliterated Fable MTP27B—
Cogito V1 Preview Qwen 32B32B131K
XiYanSQL QwenCoder 32B 250432B33K
Qwen35B Agent R234.7B262K
Qwen35b Agent R2O334.7B262K

Frequently Asked Questions

How much VRAM do I need to run a Qwen model?
The smallest Qwen model, SpatialLM1.1 Qwen 0.5B, runs from 1.6 GB of VRAM at Q4_K_M (smaller low-bit quantizations start at 1.5 GB with a noticeable quality loss). Larger family members need proportionally more — see the table above for every model.
Which Qwen models can I run on a 16 GB GPU?
23 of 37 Qwen models fit in 16 GB of VRAM at Q4_K_M, including Qwen Image 2.1 PE T2I, Qwen1.5 0.5B Chat, Qwen 7B Chat.
What is the most popular Qwen model to run locally?
Qwen AgentWorld 35B A3B is the most downloaded Qwen model in local-friendly quantized formats. It runs from 21.3 GB of VRAM at Q4_K_M.