Yi 1.5 Models — Hardware Requirements
3 Yi 1.5 models from 01.AI and the community, from the smallest that runs in 4.2 GB of VRAM at Q4 up to 34.4B parameters. Every row links to full quantization tables and GPU compatibility.
All Yi 1.5 Models by Size
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Yi 1.5 6B Chat | 6.1B | 4.2 GB | 4K | ||
| Yi 1.5 9B Chat | 8.8B | 6 GB | 4K | ||
| Yi 1.5 9B | 8.8B | 6 GB | 4K | ||
| Yi 1.5 34B Chat | 34.4B | 21.9 GB | 4K |
Frequently Asked Questions
- How much VRAM do I need to run a Yi 1.5 model?
- The smallest Yi 1.5 model, Yi 1.5 6B Chat, runs from 4.2 GB of VRAM at Q4_K_M (smaller low-bit quantizations start at 3.0 GB with a noticeable quality loss). Larger family members need proportionally more — see the table above for every model.
- Which Yi 1.5 models can I run on a 16 GB GPU?
- 3 of 4 Yi 1.5 models fit in 16 GB of VRAM at Q4_K_M, including Yi 1.5 6B Chat, Yi 1.5 9B Chat, Yi 1.5 9B.
- What is the most popular Yi 1.5 model to run locally?
- Yi 1.5 6B Chat is the most downloaded Yi 1.5 model in local-friendly quantized formats. It runs from 4.2 GB of VRAM at Q4_K_M.