llmrun Composite Score
The best LLMs, open and proprietary together, on one open-ended scale where 100 is the average model (overall capability). Switch to open models to see only what you can download and run.
46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built
Composite Score vs VRAM needed
This chart doesn't show proprietary models.
| # | Model | llmrun Composite Score | Coding | Agents | Math | Science | Reasoning | Benchmarks | VRAM |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Claude Fable 5.221 benchmarks | Coding 156 | Agents 161 | Math 154 | Science 148 | Reasoning 165 | 21 | – | |
| 2 | Gemini 4 Carbon18 benchmarks | Coding – | Agents 163 | Math 149 | Science 147 | Reasoning 155 | 18 | – | |
| 3 | GPT 6 Astra34 benchmarks | Coding 156 | Agents 158 | Math 153 | Science 146 | Reasoning 157 | 34 | – | |
| 4 | Claude Opus 5.529 benchmarks | Coding 149 | Agents 152 | Math 151 | Science 144 | Reasoning 155 | 29 | – | |
| 5 | GPT 6.1 Sol27 benchmarks | Coding 152 | Agents 148 | Math 154 | Science 141 | Reasoning 155 | 27 | – | |
| 6 | GPT 6.1 Terra17 benchmarks | Coding 153 | Agents 146 | Math 148 | Science 138 | Reasoning 153 | 17 | – | |
| 7 | Gemini 4 Argon26 benchmarks | Coding 143 | Agents 152 | Math 145 | Science 140 | Reasoning 150 | 26 | – | |
| 8 | Claude Sonnet 5.529 benchmarks | Coding 142 | Agents 152 | Math 146 | Science 143 | Reasoning 151 | 29 | – | |
| 9 | Claude Fable 5.132 benchmarks | Coding 148 | Agents 148 | Math 148 | Science 143 | Reasoning 148 | 32 | – | |
| 10 | GPT 6 Sol27 benchmarks | Coding 148 | Agents 148 | Math 145 | Science 141 | Reasoning 144 | 27 | – | |
| 11 | GPT 5.6 Sol Pro8 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 150 | 8 | – | |
| 12 | Claude Opus 533 benchmarks | Coding 147 | Agents 145 | Math 143 | Science 139 | Reasoning 145 | 33 | – | |
| 13 | GPT 5.6 Sol34 benchmarks | Coding 145 | Agents 142 | Math 143 | Science 142 | Reasoning 144 | 34 | – | |
| 14 | GPT 5.5 Pro9 benchmarks | Coding – | Agents – | Math 142 | Science – | Reasoning 142 | 9 | – | |
| 15 | Claude Fable 533 benchmarks | Coding 148 | Agents 141 | Math 148 | Science 138 | Reasoning 139 | 33 | – | |
| 16 | Muse Wonder 1.020 benchmarks | Coding 132 | Agents 139 | Math 140 | Science 141 | Reasoning 142 | 20 | – | |
| 17 | Kimi K3.1 Proopen1712 GB · 10 benchmarks | Coding 138 | Agents 135 | Math – | Science 138 | Reasoning 134 | 10 | 1712 GB | |
| 18 | Kimi K3.1 Pro Together Max8 benchmarks | Coding – | Agents – | Math 137 | Science – | Reasoning 142 | 8 | – | |
| 19 | GPT 5.535 benchmarks | Coding 140 | Agents 136 | Math 136 | Science 136 | Reasoning 141 | 35 | – | |
| 20 | GPT 5.6 Terra31 benchmarks | Coding 138 | Agents 136 | Math 139 | Science 139 | Reasoning 138 | 31 | – | |
| 21 | GPT 5.4 Pro (Mar 05, 2026)10 benchmarks | Coding – | Agents – | Math 136 | Science 141 | Reasoning 142 | 10 | – | |
| 22 | Gemini 3 Deep Think Preview3 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 137 | 3 | – | |
| 23 | Claude Haiku 5.529 benchmarks | Coding 135 | Agents 137 | Math 136 | Science 127 | Reasoning 132 | 29 | – | |
| 24 | Inkling 2 Smallopen359 GB · 4 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 136 | 4 | 359 GB | |
| 25 | Claude Opus 4.832 benchmarks | Coding 136 | Agents 132 | Math 136 | Science 129 | Reasoning 135 | 32 | – | |
| 26 | DeepSeek V4.1 Flash 1017open458 GB · 17 benchmarks | Coding 135 | Agents 137 | Math 132 | Science 134 | Reasoning 137 | 17 | 458 GB | |
| 27 | MiMo V2.6 Pro RLopen614 GB · 8 benchmarks | Coding 125 | Agents 132 | Math – | Science 140 | Reasoning – | 8 | 614 GB | |
| 28 | GPT 5.4 (Mar 05, 2026)27 benchmarks | Coding 134 | Agents 132 | Math 133 | Science 134 | Reasoning 134 | 27 | – | |
| 29 | GPT 5.3 Codex5 benchmarks | Coding 134 | Agents 132 | Math – | Science – | Reasoning – | 5 | – | |
| 30 | Kimi K3open1670 GB · 31 benchmarks | Coding 135 | Agents 132 | Math 135 | Science 136 | Reasoning 130 | 31 | 1670 GB | |
| 31 | Muse Spark 1.322 benchmarks | Coding 135 | Agents 129 | Math 132 | Science 138 | Reasoning 133 | 22 | – | |
| 32 | Gemini 3.7 Flash27 benchmarks | Coding 124 | Agents 130 | Math 131 | Science 129 | Reasoning 136 | 27 | – | |
| 33 | Gemini 3.8 Flash32 benchmarks | Coding 131 | Agents 131 | Math 128 | Science 136 | Reasoning 138 | 32 | – | |
| 34 | MiMo V2.6 Flash RLopen187 GB · 4 benchmarks | Coding 124 | Agents – | Math – | Science 122 | Reasoning – | 4 | 187 GB | |
| 35 | GPT 6 Luna24 benchmarks | Coding 133 | Agents 130 | Math 135 | Science 128 | Reasoning 127 | 24 | – | |
| 36 | Grok 4.632 benchmarks | Coding 132 | Agents 135 | Math 129 | Science 130 | Reasoning 132 | 32 | – | |
| 37 | Claude Opus 4.730 benchmarks | Coding 130 | Agents 135 | Math 130 | Science 126 | Reasoning 132 | 30 | – | |
| 38 | Qwen3.8 Max21 benchmarks | Coding 112 | Agents 130 | Math 132 | Science 129 | Reasoning 134 | 21 | – | |
| 39 | GPT 5.2 Pro (Dec 11, 2025)6 benchmarks | Coding – | Agents – | Math 132 | Science – | Reasoning 130 | 6 | – | |
| 40 | GPT 5.6 Luna31 benchmarks | Coding 126 | Agents 127 | Math 135 | Science 129 | Reasoning 128 | 31 | – | |
| 41 | Claude Sonnet 529 benchmarks | Coding 126 | Agents 131 | Math 132 | Science 114 | Reasoning 133 | 29 | – | |
| 42 | GLM 5.3open454 GB · 27 benchmarks | Coding 130 | Agents 134 | Math 129 | Science 131 | Reasoning 130 | 27 | 454 GB | |
| 43 | DeepSeek V4.1 Flashopen458 GB · 26 benchmarks | Coding 122 | Agents 126 | Math 129 | Science 123 | Reasoning 133 | 26 | 458 GB | |
| 44 | DeepSeek V4 Pro 0813open991 GB · 21 benchmarks | Coding 125 | Agents – | Math 128 | Science 126 | Reasoning 131 | 21 | 991 GB | |
| 45 | Claude Opus 4.630 benchmarks | Coding 123 | Agents 132 | Math 128 | Science 124 | Reasoning 130 | 30 | – | |
| 46 | Qwen3.8 Max (Sep 02)11 benchmarks | Coding 133 | Agents – | Math 128 | Science 127 | Reasoning 127 | 11 | – | |
| 47 | Grok 4.727 benchmarks | Coding 134 | Agents 138 | Math 122 | Science 130 | Reasoning 129 | 27 | – | |
| 48 | Doubao Seed Evolving4 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 4 | – | |
| 49 | Step 5 Previewopen408 GB · 3 benchmarks | Coding – | Agents – | Math – | Science 134 | Reasoning – | 3 | 408 GB | |
| 50 | Gemini 3.1 Pro Preview30 benchmarks | Coding 126 | Agents 119 | Math 124 | Science 137 | Reasoning 135 | 30 | – | |
| 51 | DeepSeek V4 Flash 0731open183 GB · 21 benchmarks | Coding 121 | Agents – | Math 128 | Science 124 | Reasoning 129 | 21 | 183 GB | |
| 52 | Gemini 3.5 Flash26 benchmarks | Coding 119 | Agents 119 | Math 125 | Science 126 | Reasoning 133 | 26 | – | |
| 53 | Muse Spark 1.114 benchmarks | Coding 118 | Agents 128 | Math 127 | Science 130 | Reasoning 130 | 14 | – | |
| 54 | Muse Spark Open 816B A42Bopen552 GB · 14 benchmarks | Coding 128 | Agents 113 | Math 128 | Science 125 | Reasoning 128 | 14 | 552 GB | |
| 55 | Muse Spark 1.218 benchmarks | Coding 122 | Agents 123 | Math 128 | Science 131 | Reasoning 130 | 18 | – | |
| 56 | Grok 4.2011 benchmarks | Coding 116 | Agents 121 | Math – | Science – | Reasoning 130 | 11 | – | |
| 57 | Gemini 3.6 Flash24 benchmarks | Coding 116 | Agents 125 | Math 125 | Science 125 | Reasoning 129 | 24 | – | |
| 58 | Grok 4.529 benchmarks | Coding 127 | Agents 126 | Math 125 | Science 128 | Reasoning 128 | 29 | – | |
| 59 | Qwen3.7 Max18 benchmarks | Coding 122 | Agents – | Math 126 | Science 122 | Reasoning 127 | 18 | – | |
| 60 | GPT 5.2 (Dec 11, 2025)23 benchmarks | Coding 126 | Agents 126 | Math 124 | Science 122 | Reasoning 127 | 23 | – | |
| 61 | Claude Sonnet 4.627 benchmarks | Coding 120 | Agents 120 | Math 128 | Science 108 | Reasoning 127 | 27 | – | |
| 62 | GLM 5.3 Flashopen205 GB · 24 benchmarks | Coding 117 | Agents 128 | Math 121 | Science 124 | Reasoning 127 | 24 | 205 GB | |
| 63 | Gemini 3 Pro Preview16 benchmarks | Coding 124 | Agents 127 | Math 120 | Science 126 | Reasoning 122 | 16 | – | |
| 64 | GLM 5.2open454 GB · 26 benchmarks | Coding 120 | Agents 128 | Math 126 | Science 128 | Reasoning 120 | 26 | 454 GB | |
| 65 | Qwen3.6 Max Preview8 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 121 | 8 | – | |
| 66 | Gemini 3 Flash Preview20 benchmarks | Coding 124 | Agents 121 | Math 120 | Science – | Reasoning 123 | 20 | – | |
| 67 | Qwen3.8 27Bopen17.9 GB · 16 benchmarks | Coding 118 | Agents 122 | Math 118 | Science 112 | Reasoning 124 | 16 | 17.9 GB | |
| 68 | GPT 5.2 Codex8 benchmarks | Coding 124 | Agents 121 | Math – | Science – | Reasoning – | 8 | – | |
| 69 | Claude Opus 4.5 (Nov 01, 2025)24 benchmarks | Coding 119 | Agents 124 | Math 118 | Science 116 | Reasoning 122 | 24 | – | |
| 70 | Kimi K2.6open618 GB · 21 benchmarks | Coding 119 | Agents 122 | Math 122 | Science 121 | Reasoning 118 | 21 | 618 GB | |
| 71 | Mistral Large 4 1T A52Bopen629 GB · 24 benchmarks | Coding 119 | Agents 121 | Math 122 | Science 123 | Reasoning 121 | 24 | 629 GB | |
| 72 | Doubao Seed 2.1 Pro 2606284 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 4 | – | |
| 73 | GPT 5 Pro (Oct 06, 2025)8 benchmarks | Coding – | Agents – | Math 123 | Science – | Reasoning 119 | 8 | – | |
| 74 | Muse Spark6 benchmarks | Coding – | Agents – | Math 118 | Science 128 | Reasoning – | 6 | – | |
| 75 | Inkling Smallopen163 GB · 11 benchmarks | Coding – | Agents – | Math 117 | Science 118 | Reasoning 123 | 11 | 163 GB | |
| 76 | Beam 1.0 501B A23Bopen304 GB · 10 benchmarks | Coding 123 | Agents 118 | Math – | Science 120 | Reasoning 119 | 10 | 304 GB | |
| 77 | GPT 5 (Aug 07, 2025)25 benchmarks | Coding 120 | Agents 113 | Math 122 | Science 117 | Reasoning 117 | 25 | – | |
| 78 | Grok 4.20 0309 Reasoning8 benchmarks | Coding – | Agents – | Math 118 | Science – | Reasoning 126 | 8 | – | |
| 79 | GPT 5.1 Codex Max3 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 3 | – | |
| 80 | GPT 5.1 (Nov 13, 2025)21 benchmarks | Coding 120 | Agents 112 | Math – | Science 116 | Reasoning 119 | 21 | – | |
| 81 | Doubao Seed 2.0 Pro 2602154 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 4 | – | |
| 82 | Kimi K2.7 Codeopen618 GB · 19 benchmarks | Coding 115 | Agents 119 | Math 121 | Science 118 | Reasoning 115 | 19 | 618 GB | |
| 83 | Doubao Seed 2.1 Turbo 2606284 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 4 | – | |
| 84 | GLM 5.1open454 GB · 14 benchmarks | Coding 114 | Agents 123 | Math 117 | Science 117 | Reasoning 116 | 14 | 454 GB | |
| 85 | GPT 5.4 Mini (Mar 17, 2026)18 benchmarks | Coding 121 | Agents – | Math 120 | Science 118 | Reasoning 115 | 18 | – | |
| 86 | DeepSeek V4 Proopen960 GB · 22 benchmarks | Coding 111 | Agents – | Math 118 | Science 122 | Reasoning 119 | 22 | 960 GB | |
| 87 | MiMo V2.5 Proopen616 GB · 6 benchmarks | Coding 116 | Agents – | Math – | Science 114 | Reasoning 111 | 6 | 616 GB | |
| 88 | Inklingopen575 GB · 25 benchmarks | Coding 109 | Agents 110 | Math 112 | Science 116 | Reasoning 121 | 25 | 575 GB | |
| 89 | Doubao Seed 2.0 Lite 2604284 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 4 | – | |
| 90 | Grok 4.318 benchmarks | Coding 112 | Agents – | Math 117 | Science 118 | Reasoning 117 | 18 | – | |
| 91 | Qwen3.6 Plus16 benchmarks | Coding 108 | Agents – | Math 115 | Science 114 | Reasoning 109 | 16 | – | |
| 92 | O3 (Apr 16, 2025)20 benchmarks | Coding 114 | Agents – | Math 112 | Science 110 | Reasoning 115 | 20 | – | |
| 93 | O3 Pro (Jun 10, 2025)7 benchmarks | Coding 117 | Agents – | Math – | Science – | Reasoning 113 | 7 | – | |
| 94 | DeepSeek V4 Flashopen175 GB · 13 benchmarks | Coding 114 | Agents – | Math – | Science 111 | Reasoning 111 | 13 | 175 GB | |
| 95 | Grok 4 (Jul 09)11 benchmarks | Coding 111 | Agents 103 | Math – | Science – | Reasoning 117 | 11 | – | |
| 96 | Qwen3.7 Plus9 benchmarks | Coding 103 | Agents – | Math 114 | Science 117 | Reasoning 114 | 9 | – | |
| 97 | Kimi K2.5open618 GB · 19 benchmarks | Coding 110 | Agents 110 | Math – | Science 117 | Reasoning 115 | 19 | 618 GB | |
| 98 | Claude Sonnet 4.5 (Sep 29, 2025)23 benchmarks | Coding 109 | Agents 115 | Math 109 | Science 109 | Reasoning 115 | 23 | – | |
| 99 | Qwen3.5 397B A17Bopen243 GB · 10 benchmarks | Coding – | Agents – | Math 112 | Science 113 | Reasoning 117 | 10 | 243 GB | |
| 100 | MiniMax M3open258 GB · 22 benchmarks | Coding 114 | Agents 111 | Math 106 | Science 118 | Reasoning 109 | 22 | 258 GB | |
| 101 | GPT 5.4 Nano (Mar 17, 2026)17 benchmarks | Coding 113 | Agents – | Math 116 | Science 109 | Reasoning 112 | 17 | – | |
| 102 | DeepSeek Reasoner3 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning – | 3 | – | |
| 103 | MiniMax M2.5open140 GB · 11 benchmarks | Coding 109 | Agents 110 | Math – | Science – | Reasoning 114 | 11 | 140 GB | |
| 104 | GLM 5open454 GB · 14 benchmarks | Coding 110 | Agents 118 | Math – | Science – | Reasoning 110 | 14 | 454 GB | |
| 105 | Qwen3.6 27Bopen17.9 GB · 11 benchmarks | Coding 102 | Agents – | Math 114 | Science 111 | Reasoning 105 | 11 | 17.9 GB | |
| 106 | Grok 4.1 Fast Reasoning6 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 121 | 6 | – | |
| 107 | Grok 4 Fast6 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 111 | 6 | – | |
| 108 | GPT 5 Mini (Aug 07, 2025)21 benchmarks | Coding 110 | Agents 103 | Math 117 | Science 104 | Reasoning 111 | 21 | – | |
| 109 | DeepSeek V3.2open413 GB · 13 benchmarks | Coding – | Agents 108 | Math – | Science – | Reasoning 112 | 13 | 413 GB | |
| 110 | O4 Mini (Apr 16, 2025)20 benchmarks | Coding 110 | Agents – | Math 112 | Science 108 | Reasoning 110 | 20 | – | |
| 111 | Qwen3.5 Plus11 benchmarks | Coding – | Agents – | Math – | Science – | Reasoning 109 | 11 | – | |
| 112 | Qwen3.5 122B A10Bopen75.5 GB · 6 benchmarks | Coding – | Agents – | Math – | Science 96 | Reasoning 112 | 6 | 75.5 GB | |
| 113 | Gemini 2.5 Pro Preview (Jun 05)8 benchmarks | Coding – | Agents – | Math – | Science 114 | Reasoning 106 | 8 | – | |
| 114 | Qwen3.7 Flash4 benchmarks | Coding – | Agents – | Math 109 | Science – | Reasoning – | 4 | – | |
| 115 | Gemini 3.5 Flash Lite19 benchmarks | Coding 105 | Agents – | Math 106 | Science 110 | Reasoning 112 | 19 | – | |
| 116 | NVIDIA Nemotron 3 Ultra 550B A55B BF16open378 GB · 18 benchmarks | Coding 102 | Agents 101 | Math 112 | Science 112 | Reasoning 114 | 18 | 378 GB | |
| 117 | GLM 4.7open218 GB · 13 benchmarks | Coding 101 | Agents 106 | Math 111 | Science 111 | Reasoning 111 | 13 | 218 GB | |
| 118 | Gemini 2.5 Pro Exp (Mar 25)6 benchmarks | Coding – | Agents – | Math – | Science 112 | Reasoning – | 6 | – | |
| 119 | DeepSeek V3.2 Expopen413 GB · 10 benchmarks | Coding 107 | Agents – | Math – | Science 101 | Reasoning 113 | 10 | 413 GB | |
| 120 | Gemini 3.1 Flash Lite11 benchmarks | Coding 111 | Agents – | Math 109 | Science 108 | Reasoning 107 | 11 | – |
The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.
Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.
VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.
How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.
Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.