llmrun
Coding

LiveBench Coding Leaderboard

LiveBench Coding evaluates code generation and completion on fresh, contamination-free programming tasks that are updated regularly.

Source: livebench13 open models ranked+39 proprietaryData through Nov 2025

Open modelsAll models

Open models ranked on LiveBench Coding

# shows rank among open models / rank overall (including proprietary).

#ModelScore
1 / 5QwQ 32B · 32.8B
72.2
2 / 6DeepSeek v3 0324 · 684.5B
70.9
3 / 10DeepSeek R1 · 684.5B
66.7
4 / 18Qwen2.5 Coder 32B Instruct · 32.8B
56.9
5 / 22DeepSeek R1 Distill Llama 70B · 70B
51.6
6 / 33Gemma 3 27B IT · 27.4B
39.9
7 / 36QwQ 32B Preview · 32.8B
37.2
8 / 37Llama 3.3 70B Instruct · 70.6B
36.6
9 / 40Gemma 2 27B IT · 27.2B
36.0
10 / 43DeepSeek R1 Distill Qwen 32B · 32.8B
33.7
11 / 44Phi 4 · 14.7B
30.7
12 / 46Gemma 2 9B IT · 9.2B
22.5
13 / 51Phi 3 Mini 4k Instruct · 3.8B
15.5

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

10B100Bmodel size (log scale) →72.215.5DeepSeek v3 0324 · 685B · 70.9DeepSeek R1 · 685B · 66.7Qwen2.5 Coder 32B Instruct · 33B · 56.9DeepSeek R1 Distill Llama 70B · 70B · 51.6QwQ 32B Preview · 33B · 37.2Llama 3.3 70B Instruct · 71B · 36.6DeepSeek R1 Distill Qwen 32B · 33B · 33.7Phi 3 Mini 4k Instruct · 4B · 15.5Phi 3 Mini 4k InstructGemma 2 9B IT · 9B · 22.5Gemma 2 9B ITPhi 4 · 15B · 30.7Phi 4Gemma 2 27B IT · 27B · 36.0Gemma 2 27B ITGemma 3 27B IT · 27B · 39.9Gemma 3 27B ITQwQ 32B · 33B · 72.2QwQ 32B
Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.
  • Phi 3 Mini 4k Instruct, 4B, score 15.5 — on the efficiency frontier (best score at its size or smaller).
  • Gemma 2 9B IT, 9B, score 22.5 — on the efficiency frontier (best score at its size or smaller).
  • Phi 4, 15B, score 30.7 — on the efficiency frontier (best score at its size or smaller).
  • Gemma 2 27B IT, 27B, score 36.0 — on the efficiency frontier (best score at its size or smaller).
  • Gemma 3 27B IT, 27B, score 39.9 — on the efficiency frontier (best score at its size or smaller).
  • QwQ 32B, 33B, score 72.2 — on the efficiency frontier (best score at its size or smaller).

LiveBench Coding: frequently asked questions

What is the best open LLM on LiveBench Coding?
QwQ 32B is the top open model on LiveBench Coding, scoring 72.2. Among all models tested — including proprietary ones — it ranks #5.
What's the best LiveBench Coding model you can run on a 24 GB GPU?
QwQ 32B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (about 18 GB), scoring 72.2 on LiveBench Coding.
What's the best LiveBench Coding model you can run on a 12 GB GPU?
Phi 4 is the highest-scoring open model that fits in 12 GB at 4-bit quantization (about 8 GB), scoring 30.7 on LiveBench Coding.
Can open models match proprietary models on LiveBench Coding?
Not quite on LiveBench Coding: the strongest proprietary model (gemini-2.5-pro-exp-03-25) scores 85.9, ahead of the best open model (QwQ 32B) at 72.2 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.