Llama Models — Hardware Requirements
20 Llama models from alpindale and the community, from the smallest that runs in 0.0 GB of VRAM at Q4 up to 8.2B parameters. Every row links to full quantization tables and GPU compatibility.
All Llama Models by Size
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Llama 68M | 68M | 0.0 GB | 2K | ||
| Llama 160M | 162M | 0.5 GB | 2K | ||
| MobileLLaMA 1.4B Chat | 1.4B | 1.5 GB | 2K | ||
| Llama Guard 3 1B | 1.5B | 1.7 GB | 131K | ||
| Llama 7B | 6.7B | 4.5 GB | 2K | ||
| Open Llama 7B | 7B | 4.6 GB | 2K | ||
| Llama XLAM 2 8B Fc R | 8.0B | 7.3 GB | 131K | ||
| Llama Guard 3 8B | 8.0B | 7.9 GB | — | ||
| Meta Llama Guard 2 8B | 8.0B | 7.9 GB | — |
Community variants and fine-tunes(5)
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| MicroLlama v2 | 45M | 0.3 GB | 2K | ||
| Smol Llama 101M GQA | 101M | 0.4 GB | 1K | ||
| Llama Poro 2 8B Instruct | 8.0B | 6.2 GB | 8K | ||
| Llamatron 8B V1 | 8.0B | 7.3 GB | 131K | ||
| Llama Krikri 8B Instruct | 8.2B | 7.4 GB | 131K |
Frequently Asked Questions
- How much VRAM do I need to run a Llama model?
- The smallest Llama model, Llama 68M, runs from 0.0 GB of VRAM at Q4_K_M. Larger family members need proportionally more — see the table above for every model.
- Which Llama models can I run on a 16 GB GPU?
- 14 of 14 Llama models fit in 16 GB of VRAM at Q4_K_M, including Llama Guard 3 1B, Llama XLAM 2 8B Fc R, Llama 160M.
- What is the most popular Llama model to run locally?
- Llama Guard 3 1B is the most downloaded Llama model in local-friendly quantized formats. It runs from 1.7 GB of VRAM at Q4_K_M.