llmrun

llmrun Composite Score · Math

The best open LLMs for math, ranked on competition and research math boards such as AIME and FrontierMath. The score shown is the overall llmrun Composite Score; the highlighted column is the mathematics skill score used for the order.

42 benchmarks4 sourcesUpdated 17 Oct 2026Reference scale 2026-Q4How the Composite Score is built

Math score vs VRAM needed

This chart doesn't show proprietary models.

Models ranked by math llmrun Composite Score
# (open / overall)Modelllmrun Composite ScoreCodingAgentsMathScienceReasoningBenchmarksVRAM
1 / 26DeepSeek V4.1 Flash458 GB · 20 benchmarks119–12912313320458 GB
2 / 27GLM 5.3454 GB · 23 benchmarks13113812913112623454 GB
3 / 29Muse Spark Open 816B A42B552 GB · 5 benchmarks––128––5552 GB
4 / 32DeepSeek V4 Flash 0731183 GB · 21 benchmarks121–12812412921183 GB
5 / 35GLM 5.2454 GB · 26 benchmarks12012812612912026454 GB
6 / 42Kimi K2.6618 GB · 20 benchmarks11912212212211920618 GB
7 / 44GLM 5.3 Flash205 GB · 21 benchmarks11313112112412721205 GB
8 / 45Kimi K2.7 Code618 GB · 19 benchmarks11511912111811819618 GB
9 / 51Qwen3.8 27B17.9 GB · 12 benchmarks112–1181121241217.9 GB
10 / 52GLM 5.1454 GB · 14 benchmarks11512311711711514454 GB
11 / 54Inkling Small163 GB · 12 benchmarks––11711812212163 GB
12 / 57Qwen3.6 27B17.9 GB · 12 benchmarks102–1141111061217.9 GB
13 / 58Qwen3.5 397B A17B243 GB · 9 benchmarks––112–1159243 GB
14 / 60Inkling575 GB · 22 benchmarks10410911211612122575 GB
15 / 61NVIDIA Nemotron 3 Ultra 550B A55B BF16378 GB · 15 benchmarks103–11211211515378 GB
16 / 63GLM 4.7218 GB · 13 benchmarks10110611111110413218 GB
17 / 66Qwen3.6 35B A3B22.0 GB · 12 benchmarks105–1091101071222.0 GB
18 / 71MiniMax M3258 GB · 19 benchmarks11311310611810719258 GB

The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.

Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.

VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.

How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.