Gemma 2 9B IT — Benchmarks

Benchmark scores for Gemma 2 9B IT aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Coding

BenchmarkScoreRank
LiveBench Coding22.5#12 / 13

Knowledge

BenchmarkScoreRank
MMLU72.1%#11 / 36

Math

BenchmarkScoreRank
AIME 2024/20250.6%#21 / 22
MATH Level 521.0%#18 / 23
LiveBench Math19.8#12 / 13

Reasoning

BenchmarkScoreRank
GPQA Diamond27.5%#23 / 28
LiveBench Reasoning15.2#13 / 13

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.