llmrun Composite Score · Agents
The best LLMs for agents, open and proprietary together, on one open-ended scale where 100 is the average model (agentic tool use). Switch to open models to see only what you can download and run.
46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built
Agents score vs VRAM needed
This chart doesn't show proprietary models.
| # | Model | llmrun Composite Score | Coding | Agents | Math | Science | Reasoning | Benchmarks | VRAM |
|---|---|---|---|---|---|---|---|---|---|
| 1 | Gemini 4 Carbon18 benchmarks | Coding – | Agents 163 | Math 149 | Science 147 | Reasoning 155 | 18 | – | |
| 2 | Claude Fable 5.221 benchmarks | Coding 156 | Agents 161 | Math 154 | Science 148 | Reasoning 165 | 21 | – | |
| 3 | GPT 6 Astra34 benchmarks | Coding 156 | Agents 158 | Math 153 | Science 146 | Reasoning 157 | 34 | – | |
| 4 | Claude Sonnet 5.529 benchmarks | Coding 142 | Agents 152 | Math 146 | Science 143 | Reasoning 151 | 29 | – | |
| 5 | Claude Opus 5.529 benchmarks | Coding 149 | Agents 152 | Math 151 | Science 144 | Reasoning 155 | 29 | – | |
| 6 | Gemini 4 Argon26 benchmarks | Coding 143 | Agents 152 | Math 145 | Science 140 | Reasoning 150 | 26 | – | |
| 7 | Claude Fable 5.132 benchmarks | Coding 148 | Agents 148 | Math 148 | Science 143 | Reasoning 148 | 32 | – | |
| 8 | GPT 6.1 Sol27 benchmarks | Coding 152 | Agents 148 | Math 154 | Science 141 | Reasoning 155 | 27 | – | |
| 9 | GPT 6 Sol27 benchmarks | Coding 148 | Agents 148 | Math 145 | Science 141 | Reasoning 144 | 27 | – | |
| 10 | GPT 6.1 Terra17 benchmarks | Coding 153 | Agents 146 | Math 148 | Science 138 | Reasoning 153 | 17 | – | |
| 11 | Claude Opus 533 benchmarks | Coding 147 | Agents 145 | Math 143 | Science 139 | Reasoning 145 | 33 | – | |
| 12 | GPT 5.6 Sol34 benchmarks | Coding 145 | Agents 142 | Math 143 | Science 142 | Reasoning 144 | 34 | – | |
| 13 | Claude Fable 533 benchmarks | Coding 148 | Agents 141 | Math 148 | Science 138 | Reasoning 139 | 33 | – | |
| 14 | Muse Wonder 1.020 benchmarks | Coding 132 | Agents 139 | Math 140 | Science 141 | Reasoning 142 | 20 | – | |
| 15 | Grok 4.727 benchmarks | Coding 134 | Agents 138 | Math 122 | Science 130 | Reasoning 129 | 27 | – | |
| 16 | Claude Haiku 5.529 benchmarks | Coding 135 | Agents 137 | Math 136 | Science 127 | Reasoning 132 | 29 | – | |
| 17 | DeepSeek V4.1 Flash 1017open458 GB · 17 benchmarks | Coding 135 | Agents 137 | Math 132 | Science 134 | Reasoning 137 | 17 | 458 GB | |
| 18 | GPT 5.535 benchmarks | Coding 140 | Agents 136 | Math 136 | Science 136 | Reasoning 141 | 35 | – | |
| 19 | GPT 5.6 Terra31 benchmarks | Coding 138 | Agents 136 | Math 139 | Science 139 | Reasoning 138 | 31 | – | |
| 20 | Grok 4.632 benchmarks | Coding 132 | Agents 135 | Math 129 | Science 130 | Reasoning 132 | 32 | – | |
| 21 | Claude Opus 4.730 benchmarks | Coding 130 | Agents 135 | Math 130 | Science 126 | Reasoning 132 | 30 | – | |
| 22 | Kimi K3.1 Proopen1712 GB · 10 benchmarks | Coding 138 | Agents 135 | Math – | Science 138 | Reasoning 134 | 10 | 1712 GB | |
| 23 | GLM 5.3open454 GB · 27 benchmarks | Coding 130 | Agents 134 | Math 129 | Science 131 | Reasoning 130 | 27 | 454 GB | |
| 24 | Claude Opus 4.630 benchmarks | Coding 123 | Agents 132 | Math 128 | Science 124 | Reasoning 130 | 30 | – | |
| 25 | GPT 5.3 Codex5 benchmarks | Coding 134 | Agents 132 | Math – | Science – | Reasoning – | 5 | – | |
| 26 | GPT 5.4 (Mar 05, 2026)27 benchmarks | Coding 134 | Agents 132 | Math 133 | Science 134 | Reasoning 134 | 27 | – | |
| 27 | Claude Opus 4.832 benchmarks | Coding 136 | Agents 132 | Math 136 | Science 129 | Reasoning 135 | 32 | – | |
| 28 | MiMo V2.6 Pro RLopen614 GB · 8 benchmarks | Coding 125 | Agents 132 | Math – | Science 140 | Reasoning – | 8 | 614 GB | |
| 29 | Kimi K3open1670 GB · 31 benchmarks | Coding 135 | Agents 132 | Math 135 | Science 136 | Reasoning 130 | 31 | 1670 GB | |
| 30 | Gemini 3.8 Flash32 benchmarks | Coding 131 | Agents 131 | Math 128 | Science 136 | Reasoning 138 | 32 | – | |
| 31 | Claude Sonnet 529 benchmarks | Coding 126 | Agents 131 | Math 132 | Science 114 | Reasoning 133 | 29 | – | |
| 32 | Qwen3.8 Max21 benchmarks | Coding 112 | Agents 130 | Math 132 | Science 129 | Reasoning 134 | 21 | – | |
| 33 | GPT 6 Luna24 benchmarks | Coding 133 | Agents 130 | Math 135 | Science 128 | Reasoning 127 | 24 | – | |
| 34 | Gemini 3.7 Flash27 benchmarks | Coding 124 | Agents 130 | Math 131 | Science 129 | Reasoning 136 | 27 | – | |
| 35 | Muse Spark 1.322 benchmarks | Coding 135 | Agents 129 | Math 132 | Science 138 | Reasoning 133 | 22 | – | |
| 36 | GLM 5.2open454 GB · 26 benchmarks | Coding 120 | Agents 128 | Math 126 | Science 128 | Reasoning 120 | 26 | 454 GB | |
| 37 | Muse Spark 1.114 benchmarks | Coding 118 | Agents 128 | Math 127 | Science 130 | Reasoning 130 | 14 | – | |
| 38 | GLM 5.3 Flashopen205 GB · 24 benchmarks | Coding 117 | Agents 128 | Math 121 | Science 124 | Reasoning 127 | 24 | 205 GB | |
| 39 | Gemini 3 Pro Preview16 benchmarks | Coding 124 | Agents 127 | Math 120 | Science 126 | Reasoning 122 | 16 | – | |
| 40 | GPT 5.6 Luna31 benchmarks | Coding 126 | Agents 127 | Math 135 | Science 129 | Reasoning 128 | 31 | – | |
| 41 | DeepSeek V4.1 Flashopen458 GB · 26 benchmarks | Coding 122 | Agents 126 | Math 129 | Science 123 | Reasoning 133 | 26 | 458 GB | |
| 42 | GPT 5.2 (Dec 11, 2025)23 benchmarks | Coding 126 | Agents 126 | Math 124 | Science 122 | Reasoning 127 | 23 | – | |
| 43 | Grok 4.529 benchmarks | Coding 127 | Agents 126 | Math 125 | Science 128 | Reasoning 128 | 29 | – | |
| 44 | Gemini 3.6 Flash24 benchmarks | Coding 116 | Agents 125 | Math 125 | Science 125 | Reasoning 129 | 24 | – | |
| 45 | Claude Opus 4.5 (Nov 01, 2025)24 benchmarks | Coding 119 | Agents 124 | Math 118 | Science 116 | Reasoning 122 | 24 | – | |
| 46 | Muse Spark 1.218 benchmarks | Coding 122 | Agents 123 | Math 128 | Science 131 | Reasoning 130 | 18 | – | |
| 47 | GLM 5.1open454 GB · 14 benchmarks | Coding 114 | Agents 123 | Math 117 | Science 117 | Reasoning 116 | 14 | 454 GB | |
| 48 | Qwen3.8 27Bopen17.9 GB · 16 benchmarks | Coding 118 | Agents 122 | Math 118 | Science 112 | Reasoning 124 | 16 | 17.9 GB | |
| 49 | Kimi K2.6open618 GB · 21 benchmarks | Coding 119 | Agents 122 | Math 122 | Science 121 | Reasoning 118 | 21 | 618 GB | |
| 50 | Grok 4.2011 benchmarks | Coding 116 | Agents 121 | Math – | Science – | Reasoning 130 | 11 | – | |
| 51 | Mistral Large 4 1T A52Bopen629 GB · 24 benchmarks | Coding 119 | Agents 121 | Math 122 | Science 123 | Reasoning 121 | 24 | 629 GB | |
| 52 | GPT 5.2 Codex8 benchmarks | Coding 124 | Agents 121 | Math – | Science – | Reasoning – | 8 | – | |
| 53 | Gemini 3 Flash Preview20 benchmarks | Coding 124 | Agents 121 | Math 120 | Science – | Reasoning 123 | 20 | – | |
| 54 | Claude Sonnet 4.627 benchmarks | Coding 120 | Agents 120 | Math 128 | Science 108 | Reasoning 127 | 27 | – | |
| 55 | Gemini 3.1 Pro Preview30 benchmarks | Coding 126 | Agents 119 | Math 124 | Science 137 | Reasoning 135 | 30 | – | |
| 56 | Kimi K2.7 Codeopen618 GB · 19 benchmarks | Coding 115 | Agents 119 | Math 121 | Science 118 | Reasoning 115 | 19 | 618 GB | |
| 57 | Gemini 3.5 Flash26 benchmarks | Coding 119 | Agents 119 | Math 125 | Science 126 | Reasoning 133 | 26 | – | |
| 58 | GLM 5open454 GB · 14 benchmarks | Coding 110 | Agents 118 | Math – | Science – | Reasoning 110 | 14 | 454 GB | |
| 59 | Beam 1.0 501B A23Bopen304 GB · 10 benchmarks | Coding 123 | Agents 118 | Math – | Science 120 | Reasoning 119 | 10 | 304 GB | |
| 60 | Gemini 3 Pro Preview (2025-11-18)2 benchmarks | — | Coding – | Agents 117 | Math – | Science – | Reasoning – | 2 | – |
| 61 | Claude Sonnet 4.5 (Sep 29, 2025)23 benchmarks | Coding 109 | Agents 115 | Math 109 | Science 109 | Reasoning 115 | 23 | – | |
| 62 | Claude 4.5 Sonnet (20250929)2 benchmarks | — | Coding – | Agents 114 | Math – | Science – | Reasoning – | 2 | – |
| 63 | Gemini 3 Pro3 benchmarks | — | Coding – | Agents 113 | Math – | Science – | Reasoning – | 3 | – |
| 64 | Muse Spark Open 816B A42Bopen552 GB · 14 benchmarks | Coding 128 | Agents 113 | Math 128 | Science 125 | Reasoning 128 | 14 | 552 GB | |
| 65 | GPT 5 (Aug 07, 2025)25 benchmarks | Coding 120 | Agents 113 | Math 122 | Science 117 | Reasoning 117 | 25 | – | |
| 66 | GPT 5.1 (Nov 13, 2025)21 benchmarks | Coding 120 | Agents 112 | Math – | Science 116 | Reasoning 119 | 21 | – | |
| 67 | Claude 4 Opus (20250514)2 benchmarks | — | Coding – | Agents 112 | Math – | Science – | Reasoning – | 2 | – |
| 68 | MiniMax M2.7open140 GB · 7 benchmarks | Coding 103 | Agents 112 | Math – | Science 112 | Reasoning – | 7 | 140 GB | |
| 69 | MiniMax M3open258 GB · 22 benchmarks | Coding 114 | Agents 111 | Math 106 | Science 118 | Reasoning 109 | 22 | 258 GB | |
| 70 | Kimi K2.5open618 GB · 19 benchmarks | Coding 110 | Agents 110 | Math – | Science 117 | Reasoning 115 | 19 | 618 GB | |
| 71 | MiniMax M2.5open140 GB · 11 benchmarks | Coding 109 | Agents 110 | Math – | Science – | Reasoning 114 | 11 | 140 GB | |
| 72 | Inklingopen575 GB · 25 benchmarks | Coding 109 | Agents 110 | Math 112 | Science 116 | Reasoning 121 | 25 | 575 GB | |
| 73 | Claude 4 Sonnet (20250514)2 benchmarks | — | Coding – | Agents 110 | Math – | Science – | Reasoning – | 2 | – |
| 74 | DeepSeek V3.2open413 GB · 13 benchmarks | Coding – | Agents 108 | Math – | Science – | Reasoning 112 | 13 | 413 GB | |
| 75 | Claude Opus 4.1 (Aug 05, 2025)14 benchmarks | Coding 106 | Agents 108 | Math 103 | Science 105 | Reasoning 117 | 14 | – | |
| 76 | Kimi K2 Thinkingopen617 GB · 9 benchmarks | Coding 103 | Agents 108 | Math – | Science – | Reasoning – | 9 | 617 GB | |
| 77 | GLM 4.7open218 GB · 13 benchmarks | Coding 101 | Agents 106 | Math 111 | Science 111 | Reasoning 111 | 13 | 218 GB | |
| 78 | GLM 4.5open218 GB · 7 benchmarks | Coding 99 | Agents 105 | Math – | Science – | Reasoning – | 7 | 218 GB | |
| 79 | o3 (2025-04-16)2 benchmarks | — | Coding – | Agents 105 | Math – | Science – | Reasoning – | 2 | – |
| 80 | Qwen3 Coder 480B A35B Instructopen291 GB · 6 benchmarks | Coding 101 | Agents 105 | Math – | Science – | Reasoning – | 6 | 291 GB | |
| 81 | MiniMax M2open140 GB · 6 benchmarks | Coding – | Agents 105 | Math – | Science – | Reasoning – | 6 | 140 GB | |
| 82 | Claude Haiku 4.5 (Oct 01, 2025)17 benchmarks | Coding 105 | Agents 104 | Math – | Science 101 | Reasoning 108 | 17 | – | |
| 83 | GLM 4.6open217 GB · 6 benchmarks | Coding 96 | Agents 104 | Math – | Science 100 | Reasoning – | 6 | 217 GB | |
| 84 | GPT 5 Mini (Aug 07, 2025)21 benchmarks | Coding 110 | Agents 103 | Math 117 | Science 104 | Reasoning 111 | 21 | – | |
| 85 | Grok 4 (Jul 09)11 benchmarks | Coding 111 | Agents 103 | Math – | Science – | Reasoning 117 | 11 | – | |
| 86 | Gemini 2.5 Pro16 benchmarks | Coding 112 | Agents 102 | Math 109 | Science 113 | Reasoning 108 | 16 | – | |
| 87 | Gemini 2.5 Pro (2025-05-06)2 benchmarks | — | Coding – | Agents 102 | Math – | Science – | Reasoning – | 2 | – |
| 88 | Kimi K2 Instructopen617 GB · 10 benchmarks | Coding 102 | Agents 102 | Math – | Science – | Reasoning 93 | 10 | 617 GB | |
| 89 | Claude 3.7 Sonnet (20250219)2 benchmarks | — | Coding – | Agents 101 | Math – | Science – | Reasoning – | 2 | – |
| 90 | NVIDIA Nemotron 3 Ultra 550B A55B BF16open378 GB · 18 benchmarks | Coding 102 | Agents 101 | Math 112 | Science 112 | Reasoning 114 | 18 | 378 GB | |
| 91 | Claude 3.5 Sonnet (Oct 22, 2024)10 benchmarks | Coding 99 | Agents 100 | Math – | Science 88 | Reasoning 97 | 10 | – | |
| 92 | o4-mini (2025-04-16)2 benchmarks | — | Coding – | Agents 96 | Math – | Science – | Reasoning – | 2 | – |
| 93 | Gemini 2.5 Flash9 benchmarks | Coding – | Agents 94 | Math – | Science – | Reasoning 104 | 9 | – | |
| 94 | Gemini 2.5 Flash (2025-04-17)2 benchmarks | — | Coding – | Agents 84 | Math – | Science – | Reasoning – | 2 | – |
| 95 | Qwen2.5 Coder 32B Instructopen24.3 GB · 3 benchmarks | Coding – | Agents 84 | Math – | Science – | Reasoning – | 3 | 24.3 GB | |
| 96 | GPT OSS 120Bopen70.8 GB · 19 benchmarks | Coding 98 | Agents 82 | Math – | Science 103 | Reasoning 96 | 19 | 70.8 GB | |
| 97 | Llama 4 Maverick Instruct2 benchmarks | — | Coding – | Agents 77 | Math – | Science – | Reasoning – | 2 | – |
| 98 | Llama 4 Scout Instruct2 benchmarks | — | Coding – | Agents 64 | Math – | Science – | Reasoning – | 2 | – |
The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.
Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.
VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.
How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.
Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.