llmrun

llmrun Composite Score · Agents

The best LLMs for agents, open and proprietary together, on one open-ended scale where 100 is the average model (agentic tool use). Switch to open models to see only what you can download and run.

46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built

Agents score vs VRAM needed

This chart doesn't show proprietary models.

Models ranked by agents llmrun Composite Score
#Modelllmrun Composite ScoreCodingAgentsMathScienceReasoningBenchmarksVRAM
1Gemini 4 Carbon18 benchmarksCoding –Agents 163Math 149Science 147Reasoning 15518–
2Claude Fable 5.221 benchmarksCoding 156Agents 161Math 154Science 148Reasoning 16521–
3GPT 6 Astra34 benchmarksCoding 156Agents 158Math 153Science 146Reasoning 15734–
4Claude Sonnet 5.529 benchmarksCoding 142Agents 152Math 146Science 143Reasoning 15129–
5Claude Opus 5.529 benchmarksCoding 149Agents 152Math 151Science 144Reasoning 15529–
6Gemini 4 Argon26 benchmarksCoding 143Agents 152Math 145Science 140Reasoning 15026–
7Claude Fable 5.132 benchmarksCoding 148Agents 148Math 148Science 143Reasoning 14832–
8GPT 6.1 Sol27 benchmarksCoding 152Agents 148Math 154Science 141Reasoning 15527–
9GPT 6 Sol27 benchmarksCoding 148Agents 148Math 145Science 141Reasoning 14427–
10GPT 6.1 Terra17 benchmarksCoding 153Agents 146Math 148Science 138Reasoning 15317–
11Claude Opus 533 benchmarksCoding 147Agents 145Math 143Science 139Reasoning 14533–
12GPT 5.6 Sol34 benchmarksCoding 145Agents 142Math 143Science 142Reasoning 14434–
13Claude Fable 533 benchmarksCoding 148Agents 141Math 148Science 138Reasoning 13933–
14Muse Wonder 1.020 benchmarksCoding 132Agents 139Math 140Science 141Reasoning 14220–
15Grok 4.727 benchmarksCoding 134Agents 138Math 122Science 130Reasoning 12927–
16Claude Haiku 5.529 benchmarksCoding 135Agents 137Math 136Science 127Reasoning 13229–
17DeepSeek V4.1 Flash 1017open458 GB · 17 benchmarksCoding 135Agents 137Math 132Science 134Reasoning 13717458 GB
18GPT 5.535 benchmarksCoding 140Agents 136Math 136Science 136Reasoning 14135–
19GPT 5.6 Terra31 benchmarksCoding 138Agents 136Math 139Science 139Reasoning 13831–
20Grok 4.632 benchmarksCoding 132Agents 135Math 129Science 130Reasoning 13232–
21Claude Opus 4.730 benchmarksCoding 130Agents 135Math 130Science 126Reasoning 13230–
22Kimi K3.1 Proopen1712 GB · 10 benchmarksCoding 138Agents 135Math –Science 138Reasoning 134101712 GB
23GLM 5.3open454 GB · 27 benchmarksCoding 130Agents 134Math 129Science 131Reasoning 13027454 GB
24Claude Opus 4.630 benchmarksCoding 123Agents 132Math 128Science 124Reasoning 13030–
25GPT 5.3 Codex5 benchmarksCoding 134Agents 132Math –Science –Reasoning –5–
26GPT 5.4 (Mar 05, 2026)27 benchmarksCoding 134Agents 132Math 133Science 134Reasoning 13427–
27Claude Opus 4.832 benchmarksCoding 136Agents 132Math 136Science 129Reasoning 13532–
28MiMo V2.6 Pro RLopen614 GB · 8 benchmarksCoding 125Agents 132Math –Science 140Reasoning –8614 GB
29Kimi K3open1670 GB · 31 benchmarksCoding 135Agents 132Math 135Science 136Reasoning 130311670 GB
30Gemini 3.8 Flash32 benchmarksCoding 131Agents 131Math 128Science 136Reasoning 13832–
31Claude Sonnet 529 benchmarksCoding 126Agents 131Math 132Science 114Reasoning 13329–
32Qwen3.8 Max21 benchmarksCoding 112Agents 130Math 132Science 129Reasoning 13421–
33GPT 6 Luna24 benchmarksCoding 133Agents 130Math 135Science 128Reasoning 12724–
34Gemini 3.7 Flash27 benchmarksCoding 124Agents 130Math 131Science 129Reasoning 13627–
35Muse Spark 1.322 benchmarksCoding 135Agents 129Math 132Science 138Reasoning 13322–
36GLM 5.2open454 GB · 26 benchmarksCoding 120Agents 128Math 126Science 128Reasoning 12026454 GB
37Muse Spark 1.114 benchmarksCoding 118Agents 128Math 127Science 130Reasoning 13014–
38GLM 5.3 Flashopen205 GB · 24 benchmarksCoding 117Agents 128Math 121Science 124Reasoning 12724205 GB
39Gemini 3 Pro Preview16 benchmarksCoding 124Agents 127Math 120Science 126Reasoning 12216–
40GPT 5.6 Luna31 benchmarksCoding 126Agents 127Math 135Science 129Reasoning 12831–
41DeepSeek V4.1 Flashopen458 GB · 26 benchmarksCoding 122Agents 126Math 129Science 123Reasoning 13326458 GB
42GPT 5.2 (Dec 11, 2025)23 benchmarksCoding 126Agents 126Math 124Science 122Reasoning 12723–
43Grok 4.529 benchmarksCoding 127Agents 126Math 125Science 128Reasoning 12829–
44Gemini 3.6 Flash24 benchmarksCoding 116Agents 125Math 125Science 125Reasoning 12924–
45Claude Opus 4.5 (Nov 01, 2025)24 benchmarksCoding 119Agents 124Math 118Science 116Reasoning 12224–
46Muse Spark 1.218 benchmarksCoding 122Agents 123Math 128Science 131Reasoning 13018–
47GLM 5.1open454 GB · 14 benchmarksCoding 114Agents 123Math 117Science 117Reasoning 11614454 GB
48Qwen3.8 27Bopen17.9 GB · 16 benchmarksCoding 118Agents 122Math 118Science 112Reasoning 1241617.9 GB
49Kimi K2.6open618 GB · 21 benchmarksCoding 119Agents 122Math 122Science 121Reasoning 11821618 GB
50Grok 4.2011 benchmarksCoding 116Agents 121Math –Science –Reasoning 13011–
51Mistral Large 4 1T A52Bopen629 GB · 24 benchmarksCoding 119Agents 121Math 122Science 123Reasoning 12124629 GB
52GPT 5.2 Codex8 benchmarksCoding 124Agents 121Math –Science –Reasoning –8–
53Gemini 3 Flash Preview20 benchmarksCoding 124Agents 121Math 120Science –Reasoning 12320–
54Claude Sonnet 4.627 benchmarksCoding 120Agents 120Math 128Science 108Reasoning 12727–
55Gemini 3.1 Pro Preview30 benchmarksCoding 126Agents 119Math 124Science 137Reasoning 13530–
56Kimi K2.7 Codeopen618 GB · 19 benchmarksCoding 115Agents 119Math 121Science 118Reasoning 11519618 GB
57Gemini 3.5 Flash26 benchmarksCoding 119Agents 119Math 125Science 126Reasoning 13326–
58GLM 5open454 GB · 14 benchmarksCoding 110Agents 118Math –Science –Reasoning 11014454 GB
59Beam 1.0 501B A23Bopen304 GB · 10 benchmarksCoding 123Agents 118Math –Science 120Reasoning 11910304 GB
60Gemini 3 Pro Preview (2025-11-18)2 benchmarks—Coding –Agents 117Math –Science –Reasoning –2–
61Claude Sonnet 4.5 (Sep 29, 2025)23 benchmarksCoding 109Agents 115Math 109Science 109Reasoning 11523–
62Claude 4.5 Sonnet (20250929)2 benchmarks—Coding –Agents 114Math –Science –Reasoning –2–
63Gemini 3 Pro3 benchmarks—Coding –Agents 113Math –Science –Reasoning –3–
64Muse Spark Open 816B A42Bopen552 GB · 14 benchmarksCoding 128Agents 113Math 128Science 125Reasoning 12814552 GB
65GPT 5 (Aug 07, 2025)25 benchmarksCoding 120Agents 113Math 122Science 117Reasoning 11725–
66GPT 5.1 (Nov 13, 2025)21 benchmarksCoding 120Agents 112Math –Science 116Reasoning 11921–
67Claude 4 Opus (20250514)2 benchmarks—Coding –Agents 112Math –Science –Reasoning –2–
68MiniMax M2.7open140 GB · 7 benchmarksCoding 103Agents 112Math –Science 112Reasoning –7140 GB
69MiniMax M3open258 GB · 22 benchmarksCoding 114Agents 111Math 106Science 118Reasoning 10922258 GB
70Kimi K2.5open618 GB · 19 benchmarksCoding 110Agents 110Math –Science 117Reasoning 11519618 GB
71MiniMax M2.5open140 GB · 11 benchmarksCoding 109Agents 110Math –Science –Reasoning 11411140 GB
72Inklingopen575 GB · 25 benchmarksCoding 109Agents 110Math 112Science 116Reasoning 12125575 GB
73Claude 4 Sonnet (20250514)2 benchmarks—Coding –Agents 110Math –Science –Reasoning –2–
74DeepSeek V3.2open413 GB · 13 benchmarksCoding –Agents 108Math –Science –Reasoning 11213413 GB
75Claude Opus 4.1 (Aug 05, 2025)14 benchmarksCoding 106Agents 108Math 103Science 105Reasoning 11714–
76Kimi K2 Thinkingopen617 GB · 9 benchmarksCoding 103Agents 108Math –Science –Reasoning –9617 GB
77GLM 4.7open218 GB · 13 benchmarksCoding 101Agents 106Math 111Science 111Reasoning 11113218 GB
78GLM 4.5open218 GB · 7 benchmarksCoding 99Agents 105Math –Science –Reasoning –7218 GB
79o3 (2025-04-16)2 benchmarks—Coding –Agents 105Math –Science –Reasoning –2–
80Qwen3 Coder 480B A35B Instructopen291 GB · 6 benchmarksCoding 101Agents 105Math –Science –Reasoning –6291 GB
81MiniMax M2open140 GB · 6 benchmarksCoding –Agents 105Math –Science –Reasoning –6140 GB
82Claude Haiku 4.5 (Oct 01, 2025)17 benchmarksCoding 105Agents 104Math –Science 101Reasoning 10817–
83GLM 4.6open217 GB · 6 benchmarksCoding 96Agents 104Math –Science 100Reasoning –6217 GB
84GPT 5 Mini (Aug 07, 2025)21 benchmarksCoding 110Agents 103Math 117Science 104Reasoning 11121–
85Grok 4 (Jul 09)11 benchmarksCoding 111Agents 103Math –Science –Reasoning 11711–
86Gemini 2.5 Pro16 benchmarksCoding 112Agents 102Math 109Science 113Reasoning 10816–
87Gemini 2.5 Pro (2025-05-06)2 benchmarks—Coding –Agents 102Math –Science –Reasoning –2–
88Kimi K2 Instructopen617 GB · 10 benchmarksCoding 102Agents 102Math –Science –Reasoning 9310617 GB
89Claude 3.7 Sonnet (20250219)2 benchmarks—Coding –Agents 101Math –Science –Reasoning –2–
90NVIDIA Nemotron 3 Ultra 550B A55B BF16open378 GB · 18 benchmarksCoding 102Agents 101Math 112Science 112Reasoning 11418378 GB
91Claude 3.5 Sonnet (Oct 22, 2024)10 benchmarksCoding 99Agents 100Math –Science 88Reasoning 9710–
92o4-mini (2025-04-16)2 benchmarks—Coding –Agents 96Math –Science –Reasoning –2–
93Gemini 2.5 Flash9 benchmarksCoding –Agents 94Math –Science –Reasoning 1049–
94Gemini 2.5 Flash (2025-04-17)2 benchmarks—Coding –Agents 84Math –Science –Reasoning –2–
95Qwen2.5 Coder 32B Instructopen24.3 GB · 3 benchmarksCoding –Agents 84Math –Science –Reasoning –324.3 GB
96GPT OSS 120Bopen70.8 GB · 19 benchmarksCoding 98Agents 82Math –Science 103Reasoning 961970.8 GB
97Llama 4 Maverick Instruct2 benchmarks—Coding –Agents 77Math –Science –Reasoning –2–
98Llama 4 Scout Instruct2 benchmarks—Coding –Agents 64Math –Science –Reasoning –2–

The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.

Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.

VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.

How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.

Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.