Mistral Models — Hardware Requirements
35 Mistral models from Mistral AI and the community, from the smallest that runs in 0.3 GB of VRAM at Q4 up to 1000B parameters. Every row links to full quantization tables and GPU compatibility.
All Mistral Models by Size
Community variants and fine-tunes(7)
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| PicoMistral 23M | 24M | 0.3 GB | 1K | ||
| OpenHermes 2.5 Mistral 7B | 7B | 6.7 GB | 33K | ||
| Mistral 7B v0.2 | 7.2B | 6.8 GB | 33K | ||
| Hermes 2 Pro Mistral 7B | 7.2B | 6.8 GB | 33K | ||
| Mistral Nemo 2407 12B Thinking Claude Gemini GPT5.2 Uncensored HERETIC | 12.2B | 11.0 GB | 1024K | ||
| Mistral Small 24B Instruct 2501 Quantized.w8a8 | 23.6B | 17.8 GB | 33K | ||
| Mistral Small 3.2 24B Qiskit | 24.0B | 18.1 GB | 131K |
How Mistral Compares — llmrun Composite Score
Mistral Large 4 1T A52B is the highest-scoring Mistral model with an llmrun Composite Score of 118.5 — #18 among 106 open models. The top proprietary model, Gemini 4 Carbon, scores 158.6. Click a model to see its full benchmark breakdown.
Gemini 4 Carbon · proprietary158.6
GPT 6 Astra · proprietary156.2
Claude Opus 5.5 · proprietary153.0
GPT 6.1 Sol · proprietary151.7
GPT 6.1 Terra · proprietary150.1
Kimi K3.1 Pro142.8
MiMo V2.6 Pro RL133.3
Kimi K3132.7
MiMo V2.6 Flash RL131.9
GLM 5.3130.1
DeepSeek V4.1 Flash129.4
DeepSeek V4 Pro 0813129.2
Frequently Asked Questions
- How much VRAM do I need to run a Mistral model?
- The smallest Mistral model, PicoMistral 23M, runs from 0.3 GB of VRAM at Q4_K_M. Larger family members need proportionally more — see the table above for every model.
- Which Mistral models can I run on a 16 GB GPU?
- 20 of 39 Mistral models fit in 16 GB of VRAM at Q4_K_M, including Mistral 7B v0.3, Mistral 7B Instruct v0.2, Mistral 7B Instruct v0.3.
- What is the most popular Mistral model to run locally?
- Mistral 7B v0.3 is the most downloaded Mistral model in local-friendly quantized formats. It runs from 6.8 GB of VRAM at Q4_K_M.
- How do Mistral models score on benchmarks?
- Mistral Large 4 1T A52B leads the family with an llmrun Composite Score of 118.5, ranking #18 among 106 open models, while the top proprietary model, Gemini 4 Carbon, scores 158.6. See the comparison chart above for the full standings.