Gemma 2 27B IT — Benchmarks

Benchmark scores for Gemma 2 27B IT aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Overall rank: #100 of 123 open modelscomposite 29.9/100 across 5 benchmarks in 3 categories · methodology

Knowledge

BenchmarkScoreOpen rankAll models
MMLU-Pro56.5%#56 / 119#151 / 259
MMLU75.7%#17 / 77#42 / 136

Math

BenchmarkScoreOpen rankAll models
AIME 2024/20251.4%#68 / 74#259 / 270
MATH Level 527.9%#20 / 32#79 / 108

Reasoning

BenchmarkScoreOpen rankAll models
GPQA Diamond36.5%#64 / 83#253 / 291

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.