llmrun Composite Score · Coding
The best LLMs for coding, open and proprietary together, on one open-ended scale where 100 is the average model (coding). Switch to open models to see only what you can download and run.
46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built
Coding score vs VRAM needed
This chart doesn't show proprietary models.
| # | Model | llmrun Composite Score | Coding | Agents | Math | Science | Reasoning | Benchmarks | VRAM |
|---|---|---|---|---|---|---|---|---|---|
| 121 | MiMo v2 Flashopen187 GB · 3 benchmarks | — | Coding 100 | Agents – | Math – | Science 83 | Reasoning – | 3 | 187 GB |
| 122 | DeepSeek R1open412 GB · 12 benchmarks | Coding 100 | Agents – | Math – | Science 99 | Reasoning 95 | 12 | 412 GB | |
| 123 | Kimi K2 Instruct 0905open617 GB · 6 benchmarks | Coding 100 | Agents – | Math – | Science – | Reasoning – | 6 | 617 GB | |
| 124 | DeepSeek v3 0324open412 GB · 12 benchmarks | Coding 100 | Agents – | Math – | Science 98 | Reasoning 88 | 12 | 412 GB | |
| 125 | GPT 4.1 (Apr 14, 2025)16 benchmarks | Coding 99 | Agents – | Math 92 | Science 96 | Reasoning 92 | 16 | – | |
| 126 | Claude 3.5 Sonnet (Oct 22, 2024)10 benchmarks | Coding 99 | Agents 100 | Math – | Science 88 | Reasoning 97 | 10 | – | |
| 127 | GLM 4.5open218 GB · 7 benchmarks | Coding 99 | Agents 105 | Math – | Science – | Reasoning – | 7 | 218 GB | |
| 128 | Grok 3 Mini Beta6 benchmarks | Coding 99 | Agents – | Math – | Science – | Reasoning – | 6 | – | |
| 129 | Grok Code Fast 13 benchmarks | Coding 99 | Agents – | Math – | Science – | Reasoning – | 3 | – | |
| 130 | Qwen3.5 27Bopen17.9 GB · 6 benchmarks | Coding 98 | Agents – | Math – | Science – | Reasoning 111 | 6 | 17.9 GB | |
| 131 | DeepSeek V4 Flash Vision Expopen183 GB · 6 benchmarks | — | Coding 98 | Agents – | Math – | Science – | Reasoning 123 | 6 | 183 GB |
| 132 | GPT OSS 120Bopen70.8 GB · 19 benchmarks | Coding 98 | Agents 82 | Math – | Science 103 | Reasoning 96 | 19 | 70.8 GB | |
| 133 | DeepSeek v3open412 GB · 8 benchmarks | Coding 97 | Agents – | Math – | Science 90 | Reasoning 87 | 8 | 412 GB | |
| 134 | GPT 4.5 Preview (Feb 27, 2025)10 benchmarks | Coding 96 | Agents – | Math – | Science 98 | Reasoning 96 | 10 | – | |
| 135 | GLM 4.6open217 GB · 6 benchmarks | Coding 96 | Agents 104 | Math – | Science 100 | Reasoning – | 6 | 217 GB | |
| 136 | Qwen3 Coder Nextopen48.3 GB · 3 benchmarks | — | Coding 96 | Agents – | Math – | Science 97 | Reasoning – | 3 | 48.3 GB |
| 137 | NVIDIA Nemotron 3 Super 120B A12B BF16open74.7 GB · 4 benchmarks | Coding 96 | Agents – | Math – | Science 98 | Reasoning – | 4 | 74.7 GB | |
| 138 | Gemini 2.5 Flash Lite Preview Thinking (Jun 17)5 benchmarks | Coding 95 | Agents – | Math – | Science – | Reasoning 87 | 5 | – | |
| 139 | Mercury 2.54 benchmarks | Coding 95 | Agents – | Math – | Science 99 | Reasoning – | 4 | – | |
| 140 | Trinity Large Thinkingopen271 GB · 3 benchmarks | — | Coding 93 | Agents – | Math – | Science 102 | Reasoning – | 3 | 271 GB |
| 141 | Qwen3 32Bopen22.6 GB · 8 benchmarks | Coding 93 | Agents – | Math – | Science 96 | Reasoning 92 | 8 | 22.6 GB | |
| 142 | Mistral Large 3 675B Instruct 2512open454 GB · 6 benchmarks | Coding 93 | Agents – | Math – | Science 97 | Reasoning 86 | 6 | 454 GB | |
| 143 | Mistral Medium 25086 benchmarks | Coding 92 | Agents – | Math – | Science 91 | Reasoning 92 | 6 | – | |
| 144 | GPT 4.1 Mini (Apr 14, 2025)15 benchmarks | Coding 92 | Agents – | Math 95 | Science 97 | Reasoning 91 | 15 | – | |
| 145 | O1 Mini (Sep 12, 2024)7 benchmarks | Coding 91 | Agents – | Math – | Science – | Reasoning 85 | 7 | – | |
| 146 | Claude 3.5 Haiku (Oct 22, 2024)8 benchmarks | Coding 88 | Agents – | Math – | Science 73 | Reasoning – | 8 | – | |
| 147 | Qwen3.5 35B A3Bopen22.0 GB · 8 benchmarks | Coding 86 | Agents – | Math – | Science 108 | Reasoning 107 | 8 | 22.0 GB | |
| 148 | GPT 4o (Nov 20, 2024)10 benchmarks | Coding 82 | Agents – | Math – | Science 82 | Reasoning 90 | 10 | – | |
| 149 | Llama 4 Maverick 17B 128E Instructopen273 GB · 15 benchmarks | Coding 81 | Agents – | Math – | Science 96 | Reasoning 86 | 15 | 273 GB | |
| 150 | Llama 3.3 70B Instructopen51.3 GB · 12 benchmarks | Coding 76 | Agents – | Math – | Science 81 | Reasoning 83 | 12 | 51.3 GB | |
| 151 | GPT 4.1 Nano (Apr 14, 2025)13 benchmarks | Coding 75 | Agents – | Math – | Science 82 | Reasoning 72 | 13 | – | |
| 152 | Gemma 3 27B ITopen21.7 GB · 9 benchmarks | Coding 70 | Agents – | Math – | Science 81 | Reasoning 74 | 9 | 21.7 GB | |
| 153 | GPT 4o Mini (Jul 18, 2024)13 benchmarks | Coding 68 | Agents – | Math 76 | Science – | Reasoning 73 | 13 | – | |
| 154 | Llama 3.1 8B Instructopen7.9 GB · 9 benchmarks | Coding 56 | Agents – | Math – | Science 56 | Reasoning 70 | 9 | 7.9 GB |
The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.
Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.
VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.
How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.
Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.