llmrun

llmrun Composite Score · Math

The best open LLMs for math, ranked on competition and research math boards such as AIME and FrontierMath. The score shown is the overall llmrun Composite Score; the highlighted column is the mathematics skill score used for the order.

45 benchmarks4 sourcesUpdated 17 Oct 2026Reference scale 2026-Q4How the Composite Score is built

Math score vs VRAM needed

This chart doesn't show proprietary models.

Models ranked by math llmrun Composite Score
# (open / overall)Modelllmrun Composite ScoreCodingAgentsMathScienceReasoningBenchmarksVRAM
1 / 25DeepSeek V4.1 Flash458 GB · 24 benchmarks12212812912313424458 GB
2 / 26GLM 5.3454 GB · 26 benchmarks13013312913113026454 GB
3 / 31DeepSeek V4 Flash 0731183 GB · 21 benchmarks121–12812412921183 GB
4 / 34GLM 5.2454 GB · 26 benchmarks12012812612912026454 GB
5 / 43GLM 5.3 Flash205 GB · 24 benchmarks11712712112412724205 GB
6 / 50Qwen3.8 27B17.9 GB · 15 benchmarks1201231181121241517.9 GB
7 / 51GLM 5.1454 GB · 14 benchmarks11512311711711614454 GB
8 / 53Inkling Small163 GB · 11 benchmarks––11711812311163 GB
9 / 56Qwen3.6 27B17.9 GB · 11 benchmarks102–1141111051117.9 GB
10 / 57Qwen3.5 397B A17B243 GB · 8 benchmarks––112–1178243 GB
11 / 60NVIDIA Nemotron 3 Ultra 550B A55B BF16378 GB · 17 benchmarks10410211211211617378 GB
12 / 62GLM 4.7218 GB · 13 benchmarks10110611111111113218 GB
13 / 65Qwen3.6 35B A3B22.0 GB · 11 benchmarks105–1091101041122.0 GB
14 / 70MiniMax M3258 GB · 22 benchmarks11511210611810822258 GB

The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.

Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.

VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.

How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.