llmrun
Math

LiveBench Math Leaderboard

LiveBench Math measures mathematical problem-solving on contamination-free, regularly-refreshed questions, including competition-style problems.

Source: livebench13 open models ranked+39 proprietaryData through Nov 2025

Open modelsAll models

Open models ranked on LiveBench Math

# shows rank among open models / rank overall (including proprietary).

#ModelScore
1 / 3DeepSeek R1 · 684.5B
80.7
2 / 5QwQ 32B · 32.8B
77.8
3 / 8DeepSeek v3 0324 · 684.5B
73.5
4 / 19DeepSeek R1 Distill Qwen 32B · 32.8B
59.4
5 / 21QwQ 32B Preview · 32.8B
58.3
6 / 22DeepSeek R1 Distill Llama 70B · 70B
58.1
7 / 26Gemma 3 27B IT · 27.4B
55.4
8 / 31Qwen2.5 Coder 32B Instruct · 32.8B
46.6
9 / 35Llama 3.3 70B Instruct · 70.6B
42.2
10 / 36Phi 4 · 14.7B
42.0
11 / 46Gemma 2 27B IT · 27.2B
26.5
12 / 48Gemma 2 9B IT · 9.2B
19.8
13 / 51Phi 3 Mini 4k Instruct · 3.8B
15.0

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

10B100Bmodel size (log scale) →80.715.0DeepSeek v3 0324 · 685B · 73.5DeepSeek R1 Distill Qwen 32B · 33B · 59.4QwQ 32B Preview · 33B · 58.3DeepSeek R1 Distill Llama 70B · 70B · 58.1Qwen2.5 Coder 32B Instruct · 33B · 46.6Llama 3.3 70B Instruct · 71B · 42.2Gemma 2 27B IT · 27B · 26.5Phi 3 Mini 4k Instruct · 4B · 15.0Phi 3 Mini 4k InstructGemma 2 9B IT · 9B · 19.8Gemma 2 9B ITPhi 4 · 15B · 42.0Phi 4Gemma 3 27B IT · 27B · 55.4Gemma 3 27B ITQwQ 32B · 33B · 77.8QwQ 32BDeepSeek R1 · 685B · 80.7DeepSeek R1
Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.
  • Phi 3 Mini 4k Instruct, 4B, score 15.0 — on the efficiency frontier (best score at its size or smaller).
  • Gemma 2 9B IT, 9B, score 19.8 — on the efficiency frontier (best score at its size or smaller).
  • Phi 4, 15B, score 42.0 — on the efficiency frontier (best score at its size or smaller).
  • Gemma 3 27B IT, 27B, score 55.4 — on the efficiency frontier (best score at its size or smaller).
  • QwQ 32B, 33B, score 77.8 — on the efficiency frontier (best score at its size or smaller).
  • DeepSeek R1, 685B, score 80.7 — on the efficiency frontier (best score at its size or smaller).

LiveBench Math: frequently asked questions

What is the best open LLM on LiveBench Math?
DeepSeek R1 is the top open model on LiveBench Math, scoring 80.7. Among all models tested — including proprietary ones — it ranks #3.
What's the best LiveBench Math model you can run on a 24 GB GPU?
QwQ 32B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (about 18 GB), scoring 77.8 on LiveBench Math.
What's the best LiveBench Math model you can run on a 12 GB GPU?
Phi 4 is the highest-scoring open model that fits in 12 GB at 4-bit quantization (about 8 GB), scoring 42.0 on LiveBench Math.
Can open models match proprietary models on LiveBench Math?
Not quite on LiveBench Math: the strongest proprietary model (gpt-5.1-2025-11-13_high) scores 94.5, ahead of the best open model (DeepSeek R1) at 80.7 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.