Gemma 3 12B IT — Benchmarks

Benchmark scores for Gemma 3 12B IT aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Overall rank: #67 of 78 open modelscomposite 24.5/100 across 8 benchmarks in 4 categories · methodology

Coding

BenchmarkScoreOpen rankAll models
SciCode17.4%#59 / 62#158 / 161

Instruction Following

BenchmarkScoreOpen rankAll models
LMArena Text1341.7#79 / 182#211 / 391

Knowledge

BenchmarkScoreOpen rankAll models
MMLU-Pro60.6%#57 / 144#136 / 257

Math

BenchmarkScoreOpen rankAll models
AIME 2024/202516.7%#53 / 82#214 / 270

Reasoning

BenchmarkScoreOpen rankAll models
Chess Puzzles0.0%#48 / 65#184 / 205
DTBench48.8%#61 / 67#198 / 210
LMCA4.5%#52 / 53#171 / 172
GPQA Diamond39.5%#69 / 94#246 / 289
CritPt0.0%#45 / 62#141 / 172

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.