Yi Models — Hardware Requirements
6 Yi models from 01.AI and the community, from the smallest that runs in 4.2 GB of VRAM at Q4 up to 34.4B parameters. Every row links to full quantization tables and GPU compatibility.
All Yi Models by Size
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Yi 6B | 6.1B | 4.2 GB | 4K | ||
| Yi 6B Chat | 6.1B | 4.2 GB | 4K | ||
| Yi Coder 9B Chat | 8.8B | 7.2 GB | 131K | ||
| Yi 9B | 8.8B | 6 GB | 4K | ||
| Yi 34B | 34.4B | 21.9 GB | 4K | ||
| Yi 34B Chat | 34.4B | 21.9 GB | 4K |
Frequently Asked Questions
- How much VRAM do I need to run a Yi model?
- The smallest Yi model, Yi 6B, runs from 4.2 GB of VRAM at Q4_K_M (smaller low-bit quantizations start at 2.1 GB with a noticeable quality loss). Larger family members need proportionally more — see the table above for every model.
- Which Yi models can I run on a 16 GB GPU?
- 4 of 6 Yi models fit in 16 GB of VRAM at Q4_K_M, including Yi Coder 9B Chat, Yi 6B, Yi 9B.
- What is the most popular Yi model to run locally?
- Yi Coder 9B Chat is the most downloaded Yi model in local-friendly quantized formats. It runs from 7.2 GB of VRAM at Q4_K_M.