Gemma 2 27B IT — Benchmarks

Benchmark scores for Gemma 2 27B IT aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Overall rank: #60 of 73 open modelscomposite 29.9/100 across 5 benchmarks in 3 categories · methodology

Knowledge

BenchmarkScoreOpen rankAll models
MMLU-Pro56.5%#56 / 119#151 / 259
MMLU75.7%#17 / 76#42 / 136

Math

BenchmarkScoreOpen rankAll models
AIME 2024/20251.4%#31 / 34#149 / 155
MATH Level 527.9%#20 / 32#79 / 108

Reasoning

BenchmarkScoreOpen rankAll models
GPQA Diamond36.5%#34 / 46#153 / 182

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.

Gemma 2 27B IT Benchmarks — Scores & Rankings | llmrun