llmrun
Coding

LiveBench 2026 Design Leaderboard

LiveBench 2026 Design measures layout-design tasks (LiveBench's design_layout task). It belongs to the 2026 LiveBench release (first snapshot September 2, 2026), a redesigned LiveBench in which each of seven categories is scored by a single task and questions are refreshed to limit training-set contamination. It is a different test from the original LiveBench boards, so the scores are not comparable.

Source: livebench15 open models ranked+33 proprietaryData through Sep 2026

Open models ranked on LiveBench 2026 Design

# shows rank among open models / rank overall (including proprietary).

#ModelScoreVRAM @ Q4
1 / 16MiMo V2.6 Pro RL · 1020B
78.5
~613 GB
2 / 19GLM 5.3 · 753.3B
77.3
~456 GB
3 / 20GLM 5.3 Flash · 321.3B
77.2
~195 GB
4 / 21Kimi K3 · 2779.9B
77.2
~1674 GB
5 / 22DeepSeek V4.1 Flash · 763.2B
77.0
~458 GB
6 / 24Smaug Flash · 304.2B
76.2
~609 GB
7 / 27Qwen3.8 27B · 27.8B
75.9
~17 GB
8 / 35DeepSeek V4 Flash Vision Exp · 304.6B
70.7
~183 GB
9 / 39MiniMax M3 · 427.0B
66.2
~257 GB
10 / 42NVIDIA Nemotron 3.5 Super VL 120B A12B BF16 · 124.5B
60.7
~82 GB
11 / 43Muse Spark Open 816B A42B · 822.0B
60.3
~543 GB
12 / 45NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 560.5B
58.6
~370 GB
13 / 46Gemma 4 31B IT · 31.3B
58.4
~20 GB
14 / 47Inkling · 952.4B
58.3
~572 GB
15 / 48NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 · 31.6B
43.9
~19 GB

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

100B1Tmodel size (log scale) →78.543.9Kimi K3 · 2.8T · 77.2DeepSeek V4.1 Flash · 763B · 77.0DeepSeek V4 Flash Vision Exp · 305B · 70.7MiniMax M3 · 427B · 66.2NVIDIA Nemotron 3.5 Super VL 120B A12B BF16 · 124B · 60.7Muse Spark Open 816B A42B · 822B · 60.3NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 561B · 58.6Gemma 4 31B IT · 31B · 58.4Inkling · 952B · 58.3NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 · 32B · 43.9Qwen3.8 27B · 28B · 75.9Qwen3.8 27BSmaug Flash · 304B · 76.2Smaug FlashGLM 5.3 Flash · 321B · 77.2GLM 5.3 · 753B · 77.3GLM 5.3MiMo V2.6 Pro RL · 1T · 78.5MiMo V2.6 Pro RL
Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.
  • Qwen3.8 27B, 28B, score 75.9 — on the efficiency frontier (best score at its size or smaller).
  • Smaug Flash, 304B, score 76.2 — on the efficiency frontier (best score at its size or smaller).
  • GLM 5.3 Flash, 321B, score 77.2 — on the efficiency frontier (best score at its size or smaller).
  • GLM 5.3, 753B, score 77.3 — on the efficiency frontier (best score at its size or smaller).
  • MiMo V2.6 Pro RL, 1T, score 78.5 — on the efficiency frontier (best score at its size or smaller).

LiveBench 2026 Design: frequently asked questions

What is the best open LLM on LiveBench 2026 Design?
MiMo V2.6 Pro RL is the top open model on LiveBench 2026 Design, scoring 78.5. Among all models tested — including proprietary ones — it ranks #16. The top model overall is Claude Opus 5.5 (Anthropic) at 86.9.
What's the best LiveBench 2026 Design model you can run on a 24 GB GPU?
Qwen3.8 27B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (~17 GB), scoring 75.9 on LiveBench 2026 Design.
Can open models match proprietary models on LiveBench 2026 Design?
Not quite on LiveBench 2026 Design: the strongest proprietary model (Claude Opus 5.5) scores 86.9, ahead of the best open model (MiMo V2.6 Pro RL) at 78.5 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.