Math
FrontierMath Tier 4 Leaderboard
FrontierMath Tier 4 is the hardest tier of Epoch AI's research-level mathematics benchmark, holding problems that working mathematicians consider genuinely difficult research questions. Scores here stay low even for frontier models, making it the sharpest available read on mathematical ability.
Source: epoch15 open models ranked+64 proprietaryData through Oct 2026
Open models ranked on FrontierMath Tier 4
# shows rank among open models / rank overall (including proprietary).
| # | Model | Score | VRAM @ Q4 |
|---|---|---|---|
| 1 / 30 | DeepSeek V4.1 Flash 1017 · 763.2B | 46.3% | ~458 GB |
| 2 / 35 | Kimi K3 · 2779.9B | 39.0% | ~1674 GB |
| 3 / 41 | Muse Spark Open 816B A42B · 822.0B | 31.7% | ~543 GB |
| 4 / 44 | GLM 5.2 · 753.3B | 29.3% | ~456 GB |
| 5 / 45 | GLM 5.3 · 753.3B | 29.3% | ~456 GB |
| 6 / 47 | DeepSeek V4 Pro 0813 · 1650.5B | 26.8% | ~991 GB |
| 7 / 48 | DeepSeek V4.1 Flash · 763.2B | 26.8% | ~458 GB |
| 8 / 51 | Mistral Large 4 1T A52B · 1000B | 26.8% | ~604 GB |
| 9 / 52 | Kimi K2.6 · 1026.9B | 25.6% | ~620 GB |
| 10 / 53 | DeepSeek V4 Flash 0731 · 304.2B | 24.4% | ~183 GB |
| 11 / 60 | GLM 5.3 Flash · 321.3B | 17.1% | ~195 GB |
| 12 / 63 | Inkling Small · 266.0B | 17.1% | ~160 GB |
| 13 / 67 | Kimi K2.7 Code · 1026.9B | 12.2% | ~620 GB |
| 14 / 70 | Inkling · 952.4B | 4.9% | ~572 GB |
| 15 / 74 | DeepSeek V4 Pro · 1598.8B | 2.4% | ~960 GB |
Score vs model size
Which models give the most quality for their size — the ones worth running locally.
- Inkling Small, 266B, score 17.1% — on the efficiency frontier (best score at its size or smaller).
- DeepSeek V4 Flash 0731, 304B, score 24.4% — on the efficiency frontier (best score at its size or smaller).
- GLM 5.2, 753B, score 29.3% — on the efficiency frontier (best score at its size or smaller).
- DeepSeek V4.1 Flash 1017, 763B, score 46.3% — on the efficiency frontier (best score at its size or smaller).
FrontierMath Tier 4: frequently asked questions
- What is the best open LLM on FrontierMath Tier 4?
- DeepSeek V4.1 Flash 1017 is the top open model on FrontierMath Tier 4, scoring 46.3%. Among all models tested — including proprietary ones — it ranks #29. The top model overall is GPT 6.1 Sol Max (OpenAI) at 100.0%.
- Can open models match proprietary models on FrontierMath Tier 4?
- Not quite on FrontierMath Tier 4: the strongest proprietary model (GPT 6.1 Sol Max) scores 100.0%, ahead of the best open model (DeepSeek V4.1 Flash 1017) at 46.3% — but you can run the open one yourself.
Scores aggregated from epoch. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.