Gemma 2 Models — Hardware Requirements
19 Gemma 2 models from Google and the community, from the smallest that runs in 0.3 GB of VRAM up to 27.2B parameters. Every row links to full quantization tables and GPU compatibility.
All Gemma 2 Models by Size
| Model | Params | Runs from | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Gemma 2B | 2.5B | 1.2 GB | — | ||
| Codegemma 2B | 2.5B | 1.2 GB | — | ||
| Gemma 2B IT | 2.5B | 1.2 GB | — | ||
| Nidum Gemma 2B Uncensored | 2.5B | 1.4 GB | 8K | ||
| Gemma 2 2B IT | 2.6B | 0.9 GB | 8K | ||
| Gemma 2 2B IT Abliterated | 2.6B | 1.6 GB | 8K | ||
| Gemma 2 2B | 2.6B | 1.2 GB | — | ||
| Gemma 2 2B Jpn IT | 2.6B | 5.8 GB | — | ||
| Txgemma 2B Predict | 2.6B | 1.2 GB | — | ||
| Shieldgemma 2B | 2.6B | 1.2 GB | — | ||
| T5gemma 2B 2B Ul2 | 5.6B | 2.6 GB | — | ||
| Text2cypher Gemma 2 9B IT Finetuned 2024v1 | 9B | 4.2 GB | — | ||
| Gemma 2 9B IT | 9.2B | 3.0 GB | 8K | ||
| Gemma 2 9B | 9.2B | 4.3 GB | — | ||
| Gemma 2 Mitra E | 9.2B | 4.8 GB | 8K | ||
| Gemma 2 27B IT | 27.2B | 9.0 GB | 8K |
How Gemma 2 Compares — Benchmark Rating
Gemma 2 27B IT is the highest-rated Gemma 2 model with an overall benchmark rating of 27.2/100 — #65 among 78 open models. The top proprietary model, Claude Fable 5 (high), scores 87.8. Click a model to see its full benchmark breakdown.
Claude Fable 5 (high) · proprietary87.8
Claude Opus 4.7 · proprietary86.4
Claude Fable 5 Max · proprietary82.4
GPT 6 Astra (high) · proprietary82.4
GPT 6 Astra Max · proprietary82.4
Kimi K366.8
GLM 565.9
DeepSeek R1 052863.1
Gemma 2 27B IT27.2
Gemma 2 9B IT20.3
Frequently Asked Questions
- How much VRAM do I need to run a Gemma 2 model?
- The smallest Gemma 2 model, Gemma 2 2B IT, runs from 0.9 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which Gemma 2 models can I run on a 16 GB GPU?
- 16 of 16 Gemma 2 models fit in 16 GB of VRAM at some quantization, including Gemma 2 9B IT, Gemma 2 2B IT, Gemma 2 2B IT Abliterated.
- What is the most popular Gemma 2 model to run locally?
- Gemma 2 9B IT is the most downloaded Gemma 2 model in local-friendly quantized formats. It runs from 3.0 GB of VRAM.
- How do Gemma 2 models score on benchmarks?
- Gemma 2 27B IT leads the family with an overall benchmark rating of 27.2/100, ranking #65 among 78 open models, while the top proprietary model, Claude Fable 5 (high), scores 87.8. See the comparison chart above for the full standings.