llmrun
Coding

LiveBench Coding Leaderboard

LiveBench Coding evaluates code generation and completion on fresh, contamination-free programming tasks that are updated regularly.

Source: livebench16 open models ranked+38 proprietaryData through Jun 2026

Open modelsAll models

Open models ranked on LiveBench Coding

# shows rank among open models / rank overall (including proprietary).

#ModelScore
1 / 11Kimi K3 · 2779.9B
81.5
2 / 16GLM 5.2 · 753.3B
79.7
3 / 18GLM 5.3 · 753.3B
79.0
4 / 19GLM 5.3 Flash · 321.3B
79.0
5 / 21Kimi K2.6 · 1026.9B
78.6
6 / 29DeepSeek V4 Pro 0813 · 1650.5B
77.2
7 / 36Qwen3.8 27B · 27.8B
75.7
8 / 37DeepSeek V4 Flash 0731 · 304.2B
75.0
9 / 39Kimi K2.7 Code · 1026.9B
74.0
10 / 41Qwen3.8 Flash Next · 180.0B
72.5
11 / 43Qwen3.6 27B · 27.8B
71.8
12 / 45Inkling · 952.4B
71.0
13 / 47NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 560.5B
70.7
14 / 48DeepSeek V4 Pro · 1598.8B
70.0
15 / 50DeepSeek V4 Flash · 290.9B
69.2
16 / 53MiniMax M3 · 427.0B
68.2

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

100B1Tmodel size (log scale) →81.568.2GLM 5.3 · 753B · 79.0Kimi K2.6 · 1T · 78.6DeepSeek V4 Pro 0813 · 1.7T · 77.2DeepSeek V4 Flash 0731 · 304B · 75.0Kimi K2.7 Code · 1T · 74.0Qwen3.8 Flash Next · 180B · 72.5Qwen3.6 27B · 28B · 71.8Inkling · 952B · 71.0NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 561B · 70.7DeepSeek V4 Pro · 1.6T · 70.0DeepSeek V4 Flash · 291B · 69.2MiniMax M3 · 427B · 68.2Qwen3.8 27B · 28B · 75.7Qwen3.8 27BGLM 5.3 Flash · 321B · 79.0GLM 5.3 FlashGLM 5.2 · 753B · 79.7GLM 5.2Kimi K3 · 2.8T · 81.5Kimi K3
Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.
  • Qwen3.8 27B, 28B, score 75.7 — on the efficiency frontier (best score at its size or smaller).
  • GLM 5.3 Flash, 321B, score 79.0 — on the efficiency frontier (best score at its size or smaller).
  • GLM 5.2, 753B, score 79.7 — on the efficiency frontier (best score at its size or smaller).
  • Kimi K3, 2.8T, score 81.5 — on the efficiency frontier (best score at its size or smaller).

LiveBench Coding: frequently asked questions

What is the best open LLM on LiveBench Coding?
Kimi K3 is the top open model on LiveBench Coding, scoring 81.5. Among all models tested — including proprietary ones — it ranks #10. The top model overall is Claude Fable 5.1 Max (Anthropic) at 86.4.
What's the best LiveBench Coding model you can run on a 24 GB GPU?
Qwen3.8 27B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (about 15 GB), scoring 75.7 on LiveBench Coding.
Can open models match proprietary models on LiveBench Coding?
Not quite on LiveBench Coding: the strongest proprietary model (Claude Fable 5.1 Max) scores 86.4, ahead of the best open model (Kimi K3) at 81.5 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.