Qwen2.5 Coder 32B — Benchmarks

Benchmark scores for Qwen2.5 Coder 32B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

No overall rank for Qwen2.5 Coder 32B: an overall score is only published when a model has been measured on enough of the benchmarks current models are still submitted to. Its individual scores below stand on their own — see the methodology for how the overall score is built.

Knowledge

BenchmarkScoreOpen rankAll models
ARC Challenge70.5%#18 / 56#23 / 76
MMLU79.1%#14 / 85#31 / 136
HellaSwag83.0%#10 / 47#17 / 75

Math

BenchmarkScoreOpen rankAll models
GSM8K91.1%#4 / 62#6 / 93

Reasoning

BenchmarkScoreOpen rankAll models
WinoGrande80.8%#10 / 51#18 / 79

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.