Gemma 2 Models — Hardware Requirements
21 Gemma 2 models from Google and the community, from the smallest that runs in 1.9 GB of VRAM at Q4 up to 27.2B parameters. Every row links to full quantization tables and GPU compatibility.
All Gemma 2 Models by Size
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Gemma 2B | 2.5B | 3.5 GB | — | ||
| Codegemma 2B | 2.5B | 3.5 GB | — | ||
| Gemma 2B IT | 2.5B | 3.5 GB | — | ||
| Gemma 2 2B IT | 2.6B | 2.5 GB | 8K | ||
| Gemma 2 2B | 2.6B | 3.6 GB | — | ||
| Gemma 2 2B Jpn IT | 2.6B | 3.6 GB | — | ||
| Txgemma 2B Predict | 2.6B | 3.6 GB | — | ||
| Shieldgemma 2B | 2.6B | 3.6 GB | — | ||
| T5gemma 2B 2B Ul2 IT | 5.6B | 6.0 GB | — | ||
| T5gemma 2B 2B Ul2 | 5.6B | 6.0 GB | — | ||
| Gemma 2 9B IT | 9.2B | 7.3 GB | 8K | ||
| Gemma 2 9B | 9.2B | 8.8 GB | — | ||
| Gemma 2 27B IT | 27.2B | 19.5 GB | 8K |
Community variants and fine-tunes(4)
| Model | Params | Runs from (Q4) | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Nidum Gemma 2B Uncensored | 2.5B | 1.9 GB | 8K | ||
| Gemma 2 2B IT Abliterated | 2.6B | 2.6 GB | 8K | ||
| Text2cypher Gemma 2 9B IT Finetuned 2024v1 | 9B | 8.6 GB | — | ||
| Gemma 2 Mitra E | 9.2B | 7.7 GB | 8K |
How Gemma 2 Compares — llmrun Composite Score
Gemma 2 27B IT is the highest-scoring Gemma 2 model with an llmrun Composite Score of 72.7 — #97 among 106 open models. The top proprietary model, Gemini 4 Carbon, scores 158.6. Click a model to see its full benchmark breakdown.
Gemini 4 Carbon · proprietary158.6
GPT 6 Astra · proprietary156.2
Claude Opus 5.5 · proprietary153.0
GPT 6.1 Sol · proprietary151.7
GPT 6.1 Terra · proprietary150.1
Kimi K3.1 Pro142.8
MiMo V2.6 Pro RL133.3
Kimi K3132.7
MiMo V2.6 Flash RL131.9
GLM 5.3130.1
DeepSeek V4.1 Flash129.4
DeepSeek V4 Pro 0813129.2
Gemma 2 27B IT72.7
Gemma 2 9B IT68.0
Frequently Asked Questions
- How much VRAM do I need to run a Gemma 2 model?
- The smallest Gemma 2 model, Nidum Gemma 2B Uncensored, runs from 1.9 GB of VRAM at Q4_K_M (smaller low-bit quantizations start at 1.4 GB with a noticeable quality loss). Larger family members need proportionally more — see the table above for every model.
- Which Gemma 2 models can I run on a 16 GB GPU?
- 16 of 17 Gemma 2 models fit in 16 GB of VRAM at Q4_K_M, including Gemma 2 9B IT, Gemma 2 2B IT, Gemma 2 2B IT Abliterated.
- What is the most popular Gemma 2 model to run locally?
- Gemma 2 9B IT is the most downloaded Gemma 2 model in local-friendly quantized formats. It runs from 7.3 GB of VRAM at Q4_K_M.
- How do Gemma 2 models score on benchmarks?
- Gemma 2 27B IT leads the family with an llmrun Composite Score of 72.7, ranking #97 among 106 open models, while the top proprietary model, Gemini 4 Carbon, scores 158.6. See the comparison chart above for the full standings.