Gemma 2B — Benchmarks

Benchmark scores for Gemma 2B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Overall rank: #93 of 123 open modelscomposite 33.5/100 across 10 benchmarks in 3 categories · methodology

Knowledge

Benchmark	Score	Open rank	All models
HellaSwag	71.4%	#28 / 42	#50 / 76
MMLU-Pro	15.8%	#110 / 119	#247 / 259
ARC Challenge	42.1%	#37 / 51	#58 / 77
BoolQ	69.4%	#24 / 33	#57 / 77
TriviaQA	53.2%	#17 / 18	#38 / 39
MMLU	42.3%	#64 / 77	#117 / 136

Math

Benchmark	Score	Open rank	All models
GSM8K	17.7%	#53 / 60	#75 / 93

Reasoning

Benchmark	Score	Open rank	All models
BIG-Bench Hard	35.2%	#31 / 37	#44 / 50
WinoGrande	65.4%	#31 / 46	#60 / 80
PIQA	77.3%	#26 / 35	#45 / 60

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.