llmrun Composite Score · Coding
The best LLMs for coding, open and proprietary together, on one open-ended scale where 100 is the average model (coding). Switch to open models to see only what you can download and run.
46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built
Coding score vs VRAM needed
This chart doesn't show proprietary models.
| # | Model | llmrun Composite Score | Coding | Agents | Math | Science | Reasoning | Benchmarks | VRAM |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.221 benchmarks | Coding 156 | Agents 161 | Math 154 | Science 148 | Reasoning 165 | 21 | – | |
| 2 | GPT 6 Astra34 benchmarks | Coding 156 | Agents 158 | Math 153 | Science 146 | Reasoning 157 | 34 | – | |
| 3 | GPT 6.1 Terra17 benchmarks | Coding 153 | Agents 146 | Math 148 | Science 138 | Reasoning 153 | 17 | – | |
| 4 | GPT 6.1 Sol27 benchmarks | Coding 152 | Agents 148 | Math 154 | Science 141 | Reasoning 155 | 27 | – | |
| 5 | Claude Opus 5.529 benchmarks | Coding 149 | Agents 152 | Math 151 | Science 144 | Reasoning 155 | 29 | – | |
| 6 | GPT 6 Sol27 benchmarks | Coding 148 | Agents 148 | Math 145 | Science 141 | Reasoning 144 | 27 | – | |
| 7 | Claude Fable 533 benchmarks | Coding 148 | Agents 141 | Math 148 | Science 138 | Reasoning 139 | 33 | – | |
| 8 | Claude Fable 5.132 benchmarks | Coding 148 | Agents 148 | Math 148 | Science 143 | Reasoning 148 | 32 | – | |
| 9 | Claude Opus 533 benchmarks | Coding 147 | Agents 145 | Math 143 | Science 139 | Reasoning 145 | 33 | – | |
| 10 | GPT 5.6 Sol34 benchmarks | Coding 145 | Agents 142 | Math 143 | Science 142 | Reasoning 144 | 34 | – | |
| 11 | Gemini 4 Argon26 benchmarks | Coding 143 | Agents 152 | Math 145 | Science 140 | Reasoning 150 | 26 | – | |
| 12 | Claude Sonnet 5.529 benchmarks | Coding 142 | Agents 152 | Math 146 | Science 143 | Reasoning 151 | 29 | – | |
| 13 | GPT 5.535 benchmarks | Coding 140 | Agents 136 | Math 136 | Science 136 | Reasoning 141 | 35 | – | |
| 14 | Kimi K3.1 Proopen1712 GB · 10 benchmarks | Coding 138 | Agents 135 | Math – | Science 138 | Reasoning 134 | 10 | 1712 GB | |
| 15 | GPT 5.6 Terra31 benchmarks | Coding 138 | Agents 136 | Math 139 | Science 139 | Reasoning 138 | 31 | – | |
| 16 | Claude Opus 4.832 benchmarks | Coding 136 | Agents 132 | Math 136 | Science 129 | Reasoning 135 | 32 | – | |
| 17 | Muse Spark 1.322 benchmarks | Coding 135 | Agents 129 | Math 132 | Science 138 | Reasoning 133 | 22 | – | |
| 18 | Claude Haiku 5.529 benchmarks | Coding 135 | Agents 137 | Math 136 | Science 127 | Reasoning 132 | 29 | – | |
| 19 | DeepSeek V4.1 Flash 1017open458 GB · 17 benchmarks | Coding 135 | Agents 137 | Math 132 | Science 134 | Reasoning 137 | 17 | 458 GB | |
| 20 | Kimi K3open1670 GB · 31 benchmarks | Coding 135 | Agents 132 | Math 135 | Science 136 | Reasoning 130 | 31 | 1670 GB | |
| 21 | GPT 5.3 Codex5 benchmarks | Coding 134 | Agents 132 | Math – | Science – | Reasoning – | 5 | – | |
| 22 | Grok 4.727 benchmarks | Coding 134 | Agents 138 | Math 122 | Science 130 | Reasoning 129 | 27 | – | |
| 23 | GPT 5.4 (Mar 05, 2026)27 benchmarks | Coding 134 | Agents 132 | Math 133 | Science 134 | Reasoning 134 | 27 | – | |
| 24 | Qwen3.8 Max (Sep 02)11 benchmarks | Coding 133 | Agents – | Math 128 | Science 127 | Reasoning 127 | 11 | – | |
| 25 | GPT 6 Luna24 benchmarks | Coding 133 | Agents 130 | Math 135 | Science 128 | Reasoning 127 | 24 | – | |
| 26 | Grok 4.632 benchmarks | Coding 132 | Agents 135 | Math 129 | Science 130 | Reasoning 132 | 32 | – | |
| 27 | Muse Wonder 1.020 benchmarks | Coding 132 | Agents 139 | Math 140 | Science 141 | Reasoning 142 | 20 | – | |
| 28 | Gemini 3.8 Flash32 benchmarks | Coding 131 | Agents 131 | Math 128 | Science 136 | Reasoning 138 | 32 | – | |
| 29 | GLM 5.3open454 GB · 27 benchmarks | Coding 130 | Agents 134 | Math 129 | Science 131 | Reasoning 130 | 27 | 454 GB | |
| 30 | Claude Opus 4.730 benchmarks | Coding 130 | Agents 135 | Math 130 | Science 126 | Reasoning 132 | 30 | – | |
| 31 | Muse Spark Open 816B A42Bopen552 GB · 14 benchmarks | Coding 128 | Agents 113 | Math 128 | Science 125 | Reasoning 128 | 14 | 552 GB | |
| 32 | Grok 4.529 benchmarks | Coding 127 | Agents 126 | Math 125 | Science 128 | Reasoning 128 | 29 | – | |
| 33 | GPT 5.2 (Dec 11, 2025)23 benchmarks | Coding 126 | Agents 126 | Math 124 | Science 122 | Reasoning 127 | 23 | – | |
| 34 | Gemini 3.1 Pro Preview30 benchmarks | Coding 126 | Agents 119 | Math 124 | Science 137 | Reasoning 135 | 30 | – | |
| 35 | GPT 5.6 Luna31 benchmarks | Coding 126 | Agents 127 | Math 135 | Science 129 | Reasoning 128 | 31 | – | |
| 36 | Claude Sonnet 529 benchmarks | Coding 126 | Agents 131 | Math 132 | Science 114 | Reasoning 133 | 29 | – | |
| 37 | DeepSeek V4 Pro 0813open991 GB · 21 benchmarks | Coding 125 | Agents – | Math 128 | Science 126 | Reasoning 131 | 21 | 991 GB | |
| 38 | MiMo V2.6 Pro RLopen614 GB · 8 benchmarks | Coding 125 | Agents 132 | Math – | Science 140 | Reasoning – | 8 | 614 GB | |
| 39 | Gemini 3.7 Flash27 benchmarks | Coding 124 | Agents 130 | Math 131 | Science 129 | Reasoning 136 | 27 | – | |
| 40 | GPT 5.2 Codex8 benchmarks | Coding 124 | Agents 121 | Math – | Science – | Reasoning – | 8 | – | |
| 41 | Gemini 3 Pro Preview16 benchmarks | Coding 124 | Agents 127 | Math 120 | Science 126 | Reasoning 122 | 16 | – | |
| 42 | MiMo V2.6 Flash RLopen187 GB · 4 benchmarks | Coding 124 | Agents – | Math – | Science 122 | Reasoning – | 4 | 187 GB | |
| 43 | Gemini 3 Flash Preview20 benchmarks | Coding 124 | Agents 121 | Math 120 | Science – | Reasoning 123 | 20 | – | |
| 44 | Claude Opus 4.630 benchmarks | Coding 123 | Agents 132 | Math 128 | Science 124 | Reasoning 130 | 30 | – | |
| 45 | Beam 1.0 501B A23Bopen304 GB · 10 benchmarks | Coding 123 | Agents 118 | Math – | Science 120 | Reasoning 119 | 10 | 304 GB | |
| 46 | DeepSeek V4.1 Flashopen458 GB · 26 benchmarks | Coding 122 | Agents 126 | Math 129 | Science 123 | Reasoning 133 | 26 | 458 GB | |
| 47 | Muse Spark 1.218 benchmarks | Coding 122 | Agents 123 | Math 128 | Science 131 | Reasoning 130 | 18 | – | |
| 48 | Qwen3.7 Max18 benchmarks | Coding 122 | Agents – | Math 126 | Science 122 | Reasoning 127 | 18 | – | |
| 49 | GPT 5.4 Mini (Mar 17, 2026)18 benchmarks | Coding 121 | Agents – | Math 120 | Science 118 | Reasoning 115 | 18 | – | |
| 50 | DeepSeek V4 Flash 0731open183 GB · 21 benchmarks | Coding 121 | Agents – | Math 128 | Science 124 | Reasoning 129 | 21 | 183 GB | |
| 51 | GLM 5.2open454 GB · 26 benchmarks | Coding 120 | Agents 128 | Math 126 | Science 128 | Reasoning 120 | 26 | 454 GB | |
| 52 | Claude Sonnet 4.627 benchmarks | Coding 120 | Agents 120 | Math 128 | Science 108 | Reasoning 127 | 27 | – | |
| 53 | GPT 5.1 (Nov 13, 2025)21 benchmarks | Coding 120 | Agents 112 | Math – | Science 116 | Reasoning 119 | 21 | – | |
| 54 | GPT 5 (Aug 07, 2025)25 benchmarks | Coding 120 | Agents 113 | Math 122 | Science 117 | Reasoning 117 | 25 | – | |
| 55 | Mistral Large 4 1T A52Bopen629 GB · 24 benchmarks | Coding 119 | Agents 121 | Math 122 | Science 123 | Reasoning 121 | 24 | 629 GB | |
| 56 | Claude Opus 4.5 (Nov 01, 2025)24 benchmarks | Coding 119 | Agents 124 | Math 118 | Science 116 | Reasoning 122 | 24 | – | |
| 57 | Gemini 3.5 Flash26 benchmarks | Coding 119 | Agents 119 | Math 125 | Science 126 | Reasoning 133 | 26 | – | |
| 58 | Kimi K2.6open618 GB · 21 benchmarks | Coding 119 | Agents 122 | Math 122 | Science 121 | Reasoning 118 | 21 | 618 GB | |
| 59 | Qwen3.8 27Bopen17.9 GB · 16 benchmarks | Coding 118 | Agents 122 | Math 118 | Science 112 | Reasoning 124 | 16 | 17.9 GB | |
| 60 | Muse Spark 1.114 benchmarks | Coding 118 | Agents 128 | Math 127 | Science 130 | Reasoning 130 | 14 | – | |
| 61 | GPT 5.4 2026 03.056 benchmarks | Coding 118 | Agents – | Math – | Science – | Reasoning 101 | 6 | – | |
| 62 | O3 Pro (Jun 10, 2025)7 benchmarks | Coding 117 | Agents – | Math – | Science – | Reasoning 113 | 7 | – | |
| 63 | GLM 5.3 Flashopen205 GB · 24 benchmarks | Coding 117 | Agents 128 | Math 121 | Science 124 | Reasoning 127 | 24 | 205 GB | |
| 64 | Gemini 3.6 Flash24 benchmarks | Coding 116 | Agents 125 | Math 125 | Science 125 | Reasoning 129 | 24 | – | |
| 65 | Grok 4.2011 benchmarks | Coding 116 | Agents 121 | Math – | Science – | Reasoning 130 | 11 | – | |
| 66 | MiMo V2.5 Proopen616 GB · 6 benchmarks | Coding 116 | Agents – | Math – | Science 114 | Reasoning 111 | 6 | 616 GB | |
| 67 | Kimi K2.7 Codeopen618 GB · 19 benchmarks | Coding 115 | Agents 119 | Math 121 | Science 118 | Reasoning 115 | 19 | 618 GB | |
| 68 | Gemini 3.1 Pro6 benchmarks | — | Coding 115 | Agents – | Math – | Science – | Reasoning 121 | 6 | – |
| 69 | GLM 5.1open454 GB · 14 benchmarks | Coding 114 | Agents 123 | Math 117 | Science 117 | Reasoning 116 | 14 | 454 GB | |
| 70 | MiniMax M3open258 GB · 22 benchmarks | Coding 114 | Agents 111 | Math 106 | Science 118 | Reasoning 109 | 22 | 258 GB | |
| 71 | O3 (Apr 16, 2025)20 benchmarks | Coding 114 | Agents – | Math 112 | Science 110 | Reasoning 115 | 20 | – | |
| 72 | DeepSeek V4 Flashopen175 GB · 13 benchmarks | Coding 114 | Agents – | Math – | Science 111 | Reasoning 111 | 13 | 175 GB | |
| 73 | GPT 5.4 Nano (Mar 17, 2026)17 benchmarks | Coding 113 | Agents – | Math 116 | Science 109 | Reasoning 112 | 17 | – | |
| 74 | Grok 4.318 benchmarks | Coding 112 | Agents – | Math 117 | Science 118 | Reasoning 117 | 18 | – | |
| 75 | Gemini 2.5 Pro16 benchmarks | Coding 112 | Agents 102 | Math 109 | Science 113 | Reasoning 108 | 16 | – | |
| 76 | Qwen3.8 Max21 benchmarks | Coding 112 | Agents 130 | Math 132 | Science 129 | Reasoning 134 | 21 | – | |
| 77 | Gemini 3.1 Flash Lite11 benchmarks | Coding 111 | Agents – | Math 109 | Science 108 | Reasoning 107 | 11 | – | |
| 78 | Grok Build 0.15 benchmarks | Coding 111 | Agents – | Math – | Science 118 | Reasoning – | 5 | – | |
| 79 | DeepSeek V4 Proopen960 GB · 22 benchmarks | Coding 111 | Agents – | Math 118 | Science 122 | Reasoning 119 | 22 | 960 GB | |
| 80 | Grok 4 (Jul 09)11 benchmarks | Coding 111 | Agents 103 | Math – | Science – | Reasoning 117 | 11 | – | |
| 81 | GPT 5 Mini (Aug 07, 2025)21 benchmarks | Coding 110 | Agents 103 | Math 117 | Science 104 | Reasoning 111 | 21 | – | |
| 82 | Kimi K2.5open618 GB · 19 benchmarks | Coding 110 | Agents 110 | Math – | Science 117 | Reasoning 115 | 19 | 618 GB | |
| 83 | GLM 5open454 GB · 14 benchmarks | Coding 110 | Agents 118 | Math – | Science – | Reasoning 110 | 14 | 454 GB | |
| 84 | O4 Mini (Apr 16, 2025)20 benchmarks | Coding 110 | Agents – | Math 112 | Science 108 | Reasoning 110 | 20 | – | |
| 85 | Claude Sonnet 4.5 (Sep 29, 2025)23 benchmarks | Coding 109 | Agents 115 | Math 109 | Science 109 | Reasoning 115 | 23 | – | |
| 86 | Inklingopen575 GB · 25 benchmarks | Coding 109 | Agents 110 | Math 112 | Science 116 | Reasoning 121 | 25 | 575 GB | |
| 87 | MiniMax M2.5open140 GB · 11 benchmarks | Coding 109 | Agents 110 | Math – | Science – | Reasoning 114 | 11 | 140 GB | |
| 88 | Qwen3.6 Plus16 benchmarks | Coding 108 | Agents – | Math 115 | Science 114 | Reasoning 109 | 16 | – | |
| 89 | DeepSeek R1 0528open412 GB · 10 benchmarks | Coding 107 | Agents – | Math – | Science – | Reasoning 100 | 10 | 412 GB | |
| 90 | Claude Opus 4 (May 14, 2025)13 benchmarks | Coding 107 | Agents – | Math – | Science 104 | Reasoning 108 | 13 | – | |
| 91 | DeepSeek V3.1 Terminusopen412 GB · 5 benchmarks | Coding 107 | Agents – | Math – | Science 99 | Reasoning 108 | 5 | 412 GB | |
| 92 | DeepSeek V3.2 Expopen413 GB · 10 benchmarks | Coding 107 | Agents – | Math – | Science 101 | Reasoning 113 | 10 | 413 GB | |
| 93 | Step 3.7 Flashopen139 GB · 3 benchmarks | — | Coding 107 | Agents – | Math – | Science 102 | Reasoning – | 3 | 139 GB |
| 94 | Gemma 4 31B ITopen21.7 GB · 14 benchmarks | Coding 107 | Agents – | Math – | Science 105 | Reasoning 111 | 14 | 21.7 GB | |
| 95 | Claude Opus 4.1 (Aug 05, 2025)14 benchmarks | Coding 106 | Agents 108 | Math 103 | Science 105 | Reasoning 117 | 14 | – | |
| 96 | Mercury 24 benchmarks | Coding 106 | Agents – | Math – | Science 100 | Reasoning – | 4 | – | |
| 97 | Qwen3.6 35B A3Bopen22.0 GB · 11 benchmarks | Coding 105 | Agents – | Math 109 | Science 110 | Reasoning 104 | 11 | 22.0 GB | |
| 98 | Claude Haiku 4.5 (Oct 01, 2025)17 benchmarks | Coding 105 | Agents 104 | Math – | Science 101 | Reasoning 108 | 17 | – | |
| 99 | Gemini 3.5 Flash Lite19 benchmarks | Coding 105 | Agents – | Math 106 | Science 110 | Reasoning 112 | 19 | – | |
| 100 | Claude Sonnet 4 (May 14, 2025)16 benchmarks | Coding 104 | Agents – | Math – | Science 104 | Reasoning 107 | 16 | – | |
| 101 | O1 (Dec 17, 2024)13 benchmarks | Coding 104 | Agents – | Math 104 | Science 104 | Reasoning 102 | 13 | – | |
| 102 | Gemma 4 26B A4B ITopen16.5 GB · 8 benchmarks | Coding 104 | Agents – | Math – | Science 102 | Reasoning 102 | 8 | 16.5 GB | |
| 103 | Qwen3.7 Plus9 benchmarks | Coding 103 | Agents – | Math 114 | Science 117 | Reasoning 114 | 9 | – | |
| 104 | Kimi K2 Thinkingopen617 GB · 9 benchmarks | Coding 103 | Agents 108 | Math – | Science – | Reasoning – | 9 | 617 GB | |
| 105 | MiMo V2.5open188 GB · 4 benchmarks | Coding 103 | Agents – | Math – | Science 107 | Reasoning – | 4 | 188 GB | |
| 106 | O3 Mini (Jan 31, 2025)19 benchmarks | Coding 103 | Agents – | Math 106 | Science 106 | Reasoning 100 | 19 | – | |
| 107 | MiniMax M2.7open140 GB · 7 benchmarks | Coding 103 | Agents 112 | Math – | Science 112 | Reasoning – | 7 | 140 GB | |
| 108 | Qwen3 235B A22B Thinking 2507open143 GB · 13 benchmarks | Coding 102 | Agents – | Math – | Science 108 | Reasoning 108 | 13 | 143 GB | |
| 109 | Qwen3.6 27Bopen17.9 GB · 11 benchmarks | Coding 102 | Agents – | Math 114 | Science 111 | Reasoning 105 | 11 | 17.9 GB | |
| 110 | GPT 5 Nano (Aug 07, 2025)17 benchmarks | Coding 102 | Agents – | Math 108 | Science – | Reasoning 90 | 17 | – | |
| 111 | Mistral Medium 3.5 128Bopen82.8 GB · 9 benchmarks | Coding 102 | Agents – | Math – | Science 101 | Reasoning 102 | 9 | 82.8 GB | |
| 112 | Ring 2.6 1Topen687 GB · 3 benchmarks | — | Coding 102 | Agents – | Math – | Science 109 | Reasoning – | 3 | 687 GB |
| 113 | NVIDIA Nemotron 3 Ultra 550B A55B BF16open378 GB · 18 benchmarks | Coding 102 | Agents 101 | Math 112 | Science 112 | Reasoning 114 | 18 | 378 GB | |
| 114 | GPT OSS 20Bopen13.1 GB · 10 benchmarks | Coding 102 | Agents – | Math – | Science 93 | Reasoning 91 | 10 | 13.1 GB | |
| 115 | Qwen3 235B A22B Instruct 2507open143 GB · 8 benchmarks | Coding 102 | Agents – | Math – | Science – | Reasoning 98 | 8 | 143 GB | |
| 116 | Kimi K2 Instructopen617 GB · 10 benchmarks | Coding 102 | Agents 102 | Math – | Science – | Reasoning 93 | 10 | 617 GB | |
| 117 | GLM 4.7open218 GB · 13 benchmarks | Coding 101 | Agents 106 | Math 111 | Science 111 | Reasoning 111 | 13 | 218 GB | |
| 118 | Qwen3 235B A22Bopen143 GB · 9 benchmarks | Coding 101 | Agents – | Math – | Science – | Reasoning 101 | 9 | 143 GB | |
| 119 | Qwen3 Coder 480B A35B Instructopen291 GB · 6 benchmarks | Coding 101 | Agents 105 | Math – | Science – | Reasoning – | 6 | 291 GB | |
| 120 | Gemini 2.5 Flash Preview (May 20)7 benchmarks | Coding 100 | Agents – | Math – | Science – | Reasoning 104 | 7 | – |
The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.
Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.
VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.
How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.
Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.