Gemma 3 27B IT — Benchmarks

Benchmark scores for Gemma 3 27B IT aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Coding

BenchmarkScoreRank
Aider Polyglot4.9%#12 / 12
LiveBench Coding39.9#6 / 13

Math

BenchmarkScoreRank
AIME 2024/202519.7%#10 / 22
MATH Level 574.0%#6 / 23
LiveBench Math55.4#7 / 13

Reasoning

BenchmarkScoreRank
GPQA Diamond48.9%#13 / 28
LiveBench Reasoning43.8#9 / 13

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.