llmrun
Reasoning

LiveBench 2026 Data Analysis Leaderboard

LiveBench 2026 Data Analysis measures questions answered by working with tables and structured data. It belongs to the 2026 LiveBench release (first snapshot September 2, 2026), a redesigned LiveBench in which each of seven categories is scored by a single task and questions are refreshed to limit training-set contamination. It is a different test from the original LiveBench boards, so the scores are not comparable.

Source: livebench15 open models ranked+33 proprietaryData through Sep 2026

Open models ranked on LiveBench 2026 Data Analysis

# shows rank among open models / rank overall (including proprietary).

#ModelScoreVRAM @ Q4
1 / 12DeepSeek V4 Flash Vision Exp · 304.6B
79.5
~183 GB
2 / 13DeepSeek V4.1 Flash · 763.2B
79.3
~458 GB
3 / 15Smaug Flash · 304.2B
79.1
~609 GB
4 / 16Kimi K3 · 2779.9B
78.7
~1674 GB
5 / 21Qwen3.8 27B · 27.8B
76.6
~17 GB
6 / 24GLM 5.3 Flash · 321.3B
76.4
~195 GB
7 / 25MiniMax M3 · 427.0B
76.2
~257 GB
8 / 32Inkling · 952.4B
72.8
~572 GB
9 / 33MiMo V2.6 Pro RL · 1020B
72.3
~613 GB
10 / 35GLM 5.3 · 753.3B
70.2
~456 GB
11 / 39NVIDIA Nemotron 3.5 Super VL 120B A12B BF16 · 124.5B
64.6
~82 GB
12 / 41Muse Spark Open 816B A42B · 822.0B
60.2
~543 GB
13 / 44NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 560.5B
54.5
~370 GB
14 / 46Gemma 4 31B IT · 31.3B
53.3
~20 GB
15 / 48NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 · 31.6B
43.1
~19 GB

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

100B1Tmodel size (log scale) →79.543.1DeepSeek V4.1 Flash · 763B · 79.3Kimi K3 · 2.8T · 78.7GLM 5.3 Flash · 321B · 76.4MiniMax M3 · 427B · 76.2Inkling · 952B · 72.8MiMo V2.6 Pro RL · 1T · 72.3GLM 5.3 · 753B · 70.2NVIDIA Nemotron 3.5 Super VL 120B A12B BF16 · 124B · 64.6Muse Spark Open 816B A42B · 822B · 60.2NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 561B · 54.5Gemma 4 31B IT · 31B · 53.3NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 · 32B · 43.1Qwen3.8 27B · 28B · 76.6Qwen3.8 27BSmaug Flash · 304B · 79.1Smaug FlashDeepSeek V4 Flash Vision Exp · 305B · 79.5DeepSeek V4 Flash Vis…
Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.
  • Qwen3.8 27B, 28B, score 76.6 — on the efficiency frontier (best score at its size or smaller).
  • Smaug Flash, 304B, score 79.1 — on the efficiency frontier (best score at its size or smaller).
  • DeepSeek V4 Flash Vision Exp, 305B, score 79.5 — on the efficiency frontier (best score at its size or smaller).

LiveBench 2026 Data Analysis: frequently asked questions

What is the best open LLM on LiveBench 2026 Data Analysis?
DeepSeek V4 Flash Vision Exp is the top open model on LiveBench 2026 Data Analysis, scoring 79.5. Among all models tested — including proprietary ones — it ranks #12. The top model overall is Gemini 4 Argon (Google) at 85.2.
What's the best LiveBench 2026 Data Analysis model you can run on a 24 GB GPU?
Qwen3.8 27B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (~17 GB), scoring 76.6 on LiveBench 2026 Data Analysis.
Can open models match proprietary models on LiveBench 2026 Data Analysis?
Not quite on LiveBench 2026 Data Analysis: the strongest proprietary model (Gemini 4 Argon) scores 85.2, ahead of the best open model (DeepSeek V4 Flash Vision Exp) at 79.5 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.