Kimi Models — Hardware Requirements
5 Kimi models from Moonshot AI and the community, from the smallest that runs in 0.3 GB of VRAM up to 72.7B parameters. Every row links to full quantization tables and GPU compatibility.
All Kimi Models by Size
| Model | Params | Runs from | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Kimi VL A3B Instruct | 16.4B | 5.3 GB | 131K | ||
| Kimi Linear 48B A3B Instruct | 49.1B | 14.3 GB | — | ||
| Kimi Linear 48B A3B Base | 49.1B | 14.3 GB | — | ||
| Kimi Dev 72B | 72.7B | 21.0 GB | 131K |
Frequently Asked Questions
- How much VRAM do I need to run a Kimi model?
- The smallest Kimi model, Kimi VL A3B Instruct, runs from 5.3 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which Kimi models can I run on a 16 GB GPU?
- 3 of 4 Kimi models fit in 16 GB of VRAM at some quantization, including Kimi Linear 48B A3B Instruct, Kimi VL A3B Instruct, Kimi Linear 48B A3B Base.
- What is the most popular Kimi model to run locally?
- Kimi Linear 48B A3B Instruct is the most downloaded Kimi model in local-friendly quantized formats. It runs from 14.3 GB of VRAM.