Gemma 2 27B IT — Benchmarks
Benchmark scores for Gemma 2 27B IT aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Coding
| Benchmark | Score | Rank |
|---|---|---|
| LiveBench Coding | 36.0 | #9 / 13 |
Knowledge
| Benchmark | Score | Rank |
|---|---|---|
| MMLU | 75.7% | #8 / 36 |
Math
| Benchmark | Score | Rank |
|---|---|---|
| AIME 2024/2025 | 1.4% | #19 / 22 |
| MATH Level 5 | 27.9% | #14 / 23 |
| LiveBench Math | 26.5 | #11 / 13 |
Reasoning
| Benchmark | Score | Rank |
|---|---|---|
| GPQA Diamond | 36.5% | #20 / 28 |
| LiveBench Reasoning | 28.1 | #11 / 13 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.