MiniCPM Models — Hardware Requirements
5 MiniCPM models from openbmb and the community, from the smallest that runs in 0.6 GB of VRAM up to 8x2B parameters. Every row links to full quantization tables and GPU compatibility.
All MiniCPM Models by Size
| Model | Params | Runs from | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| MiniCPM5 1B | 1.1B | 0.6 GB | 131K | ||
| Huihui MiniCPM5 1B Abliterated | 1.1B | 0.6 GB | 131K | ||
| MiniCPM5 1B SFT | 1.1B | 0.8 GB | 131K | ||
| MiniCPM 2B Sft BF16 | 2B | 1.9 GB | 4K | ||
| MiniCPM MoE 8x2B | 8x2B | 7.8 GB | 4K |
Frequently Asked Questions
- How much VRAM do I need to run a MiniCPM model?
- The smallest MiniCPM model, MiniCPM5 1B, runs from 0.6 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which MiniCPM models can I run on a 16 GB GPU?
- 5 of 5 MiniCPM models fit in 16 GB of VRAM at some quantization, including MiniCPM5 1B, Huihui MiniCPM5 1B Abliterated, MiniCPM 2B Sft BF16.
- What is the most popular MiniCPM model to run locally?
- MiniCPM5 1B is the most downloaded MiniCPM model in local-friendly quantized formats. It runs from 0.6 GB of VRAM.