llmrun
Math

LiveBench Math Leaderboard

LiveBench Math measures mathematical problem-solving on contamination-free, regularly-refreshed questions, including competition-style problems.

Source: livebench16 open models ranked+38 proprietaryData through Jun 2026

Open modelsAll models

Open models ranked on LiveBench Math

# shows rank among open models / rank overall (including proprietary).

#ModelScore
1 / 8DeepSeek V4 Pro 0813 · 1650.5B
95.1
2 / 23DeepSeek V4 Pro · 1598.8B
90.7
3 / 25GLM 5.2 · 753.3B
89.8
4 / 28NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 560.5B
88.7
5 / 29Inkling · 952.4B
88.4
6 / 31GLM 5.3 · 753.3B
87.9
7 / 36DeepSeek V4 Flash 0731 · 304.2B
86.8
8 / 38Qwen3.8 27B · 27.8B
86.2
9 / 39Qwen3.8 Flash Next · 180.0B
85.8
10 / 41Kimi K3 · 2779.9B
84.4
11 / 43Kimi K2.6 · 1026.9B
84.3
12 / 46GLM 5.3 Flash · 321.3B
81.2
13 / 47Qwen3.6 27B · 27.8B
79.9
14 / 48DeepSeek V4 Flash · 290.9B
79.7
15 / 49Kimi K2.7 Code · 1026.9B
79.6
16 / 53MiniMax M3 · 427.0B
77.0

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

100B1Tmodel size (log scale) →95.177.0Inkling · 952B · 88.4GLM 5.3 · 753B · 87.9Qwen3.8 Flash Next · 180B · 85.8Kimi K3 · 2.8T · 84.4Kimi K2.6 · 1T · 84.3GLM 5.3 Flash · 321B · 81.2Qwen3.6 27B · 28B · 79.9DeepSeek V4 Flash · 291B · 79.7Kimi K2.7 Code · 1T · 79.6MiniMax M3 · 427B · 77.0Qwen3.8 27B · 28B · 86.2Qwen3.8 27BDeepSeek V4 Flash 0731 · 304B · 86.8DeepSeek V4 Flash 0731NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 561B · 88.7NVIDIA Nemotron 3 Ult…GLM 5.2 · 753B · 89.8GLM 5.2DeepSeek V4 Pro · 1.6T · 90.7DeepSeek V4 ProDeepSeek V4 Pro 0813 · 1.7T · 95.1DeepSeek V4 Pro 0813
Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.
  • Qwen3.8 27B, 28B, score 86.2 — on the efficiency frontier (best score at its size or smaller).
  • DeepSeek V4 Flash 0731, 304B, score 86.8 — on the efficiency frontier (best score at its size or smaller).
  • NVIDIA Nemotron 3 Ultra 550B A55B BF16, 561B, score 88.7 — on the efficiency frontier (best score at its size or smaller).
  • GLM 5.2, 753B, score 89.8 — on the efficiency frontier (best score at its size or smaller).
  • DeepSeek V4 Pro, 1.6T, score 90.7 — on the efficiency frontier (best score at its size or smaller).
  • DeepSeek V4 Pro 0813, 1.7T, score 95.1 — on the efficiency frontier (best score at its size or smaller).

LiveBench Math: frequently asked questions

What is the best open LLM on LiveBench Math?
DeepSeek V4 Pro 0813 is the top open model on LiveBench Math, scoring 95.1. Among all models tested — including proprietary ones — it ranks #8. The top model overall is Claude Fable 5.1 Max (Anthropic) at 97.0.
What's the best LiveBench Math model you can run on a 24 GB GPU?
Qwen3.8 27B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (about 15 GB), scoring 86.2 on LiveBench Math.
Can open models match proprietary models on LiveBench Math?
Not quite on LiveBench Math: the strongest proprietary model (Claude Fable 5.1 Max) scores 97.0, ahead of the best open model (DeepSeek V4 Pro 0813) at 95.1 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.