Yi 1.5 Models — Hardware Requirements
3 Yi 1.5 models from 01.AI and the community, from the smallest that runs in 3.0 GB of VRAM up to 34.4B parameters. Every row links to full quantization tables and GPU compatibility.
All Yi 1.5 Models by Size
| Model | Params | Runs from | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Yi 1.5 6B Chat | 6.1B | 3.0 GB | 4K | ||
| Yi 1.5 9B Chat | 8.8B | 4.1 GB | 4K | ||
| Yi 1.5 9B | 8.8B | 4.3 GB | 4K | ||
| Yi 1.5 34B Chat | 34.4B | 12.4 GB | 4K |
Frequently Asked Questions
- How much VRAM do I need to run a Yi 1.5 model?
- The smallest Yi 1.5 model, Yi 1.5 6B Chat, runs from 3.0 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which Yi 1.5 models can I run on a 16 GB GPU?
- 4 of 4 Yi 1.5 models fit in 16 GB of VRAM at some quantization, including Yi 1.5 6B Chat, Yi 1.5 9B Chat, Yi 1.5 34B Chat.
- What is the most popular Yi 1.5 model to run locally?
- Yi 1.5 6B Chat is the most downloaded Yi 1.5 model in local-friendly quantized formats. It runs from 3.0 GB of VRAM.