InternLM Models — Hardware Requirements
6 InternLM models from InternLM and the community, from the smallest that runs in 3.4 GB of VRAM up to 20B parameters. Every row links to full quantization tables and GPU compatibility.
All InternLM Models by Size
| Model | Params | Runs from | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Internlm Chat 7B | 7B | 15.4 GB | 2K | ||
| Internlm2 5 7B Chat | 7B | 3.5 GB | 33K | ||
| Internlm 7B | 7B | 15.4 GB | 2K | ||
| Internlm2 Chat 7B | 7.7B | 3.9 GB | 33K | ||
| Internlm3 8B Instruct | 8.8B | 3.4 GB | 33K | ||
| Internlm2 5 20B Chat | 19.9B | 9.1 GB | 33K | ||
| Internlm 20B | 20B | 42.8 GB | 4K | ||
| Internlm Chat 20B | 20B | 11.3 GB | 4K |
Frequently Asked Questions
- How much VRAM do I need to run a InternLM model?
- The smallest InternLM model, Internlm3 8B Instruct, runs from 3.4 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which InternLM models can I run on a 16 GB GPU?
- 7 of 8 InternLM models fit in 16 GB of VRAM at some quantization, including Internlm3 8B Instruct, Internlm2 Chat 7B, Internlm Chat 7B.
- What is the most popular InternLM model to run locally?
- Internlm3 8B Instruct is the most downloaded InternLM model in local-friendly quantized formats. It runs from 3.4 GB of VRAM.