llmrun

llmrun Composite Score · Reasoning

The best LLMs for reasoning, open and proprietary together, on one open-ended scale where 100 is the average model (reasoning). Switch to open models to see only what you can download and run.

46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built

Reasoning score vs VRAM needed

This chart doesn't show proprietary models.

Models ranked by reasoning llmrun Composite Score
#Modelllmrun Composite ScoreCodingAgentsMathScienceReasoningBenchmarksVRAM
1Claude Fable 5.221 benchmarksCoding 156Agents 161Math 154Science 148Reasoning 16521–
2GPT 6 Astra Pro3 benchmarks—Coding –Agents –Math –Science –Reasoning 1603–
3GPT 6 Astra34 benchmarksCoding 156Agents 158Math 153Science 146Reasoning 15734–
4Gemini 4 Carbon18 benchmarksCoding –Agents 163Math 149Science 147Reasoning 15518–
5Claude Opus 5.529 benchmarksCoding 149Agents 152Math 151Science 144Reasoning 15529–
6GPT 6.1 Sol27 benchmarksCoding 152Agents 148Math 154Science 141Reasoning 15527–
7GPT 6.1 Terra17 benchmarksCoding 153Agents 146Math 148Science 138Reasoning 15317–
8Claude Sonnet 5.529 benchmarksCoding 142Agents 152Math 146Science 143Reasoning 15129–
9Gemini 4 Argon26 benchmarksCoding 143Agents 152Math 145Science 140Reasoning 15026–
10GPT 5.6 Sol Pro8 benchmarksCoding –Agents –Math –Science –Reasoning 1508–
11Claude Fable 5.132 benchmarksCoding 148Agents 148Math 148Science 143Reasoning 14832–
12Claude Opus 533 benchmarksCoding 147Agents 145Math 143Science 139Reasoning 14533–
13GPT 5.6 Sol34 benchmarksCoding 145Agents 142Math 143Science 142Reasoning 14434–
14GPT 6 Sol27 benchmarksCoding 148Agents 148Math 145Science 141Reasoning 14427–
15GPT 5.5 Pro9 benchmarksCoding –Agents –Math 142Science –Reasoning 1429–
16Muse Wonder 1.020 benchmarksCoding 132Agents 139Math 140Science 141Reasoning 14220–
17GPT 5.4 Pro (Mar 05, 2026)10 benchmarksCoding –Agents –Math 136Science 141Reasoning 14210–
18Kimi K3.1 Pro Together Max8 benchmarksCoding –Agents –Math 137Science –Reasoning 1428–
19GPT 5.535 benchmarksCoding 140Agents 136Math 136Science 136Reasoning 14135–
20Claude Fable 533 benchmarksCoding 148Agents 141Math 148Science 138Reasoning 13933–
21GPT 5.6 Terra31 benchmarksCoding 138Agents 136Math 139Science 139Reasoning 13831–
22Gemini 3.8 Flash32 benchmarksCoding 131Agents 131Math 128Science 136Reasoning 13832–
23Gemini 3 Deep Think Preview3 benchmarksCoding –Agents –Math –Science –Reasoning 1373–
24DeepSeek V4.1 Flash 1017open458 GB · 17 benchmarksCoding 135Agents 137Math 132Science 134Reasoning 13717458 GB
25Gemini 3.7 Flash27 benchmarksCoding 124Agents 130Math 131Science 129Reasoning 13627–
26Inkling 2 Smallopen359 GB · 4 benchmarksCoding –Agents –Math –Science –Reasoning 1364359 GB
27Claude Opus 4.832 benchmarksCoding 136Agents 132Math 136Science 129Reasoning 13532–
28Gemini 3.1 Pro Preview30 benchmarksCoding 126Agents 119Math 124Science 137Reasoning 13530–
29Kimi K3.1 Proopen1712 GB · 10 benchmarksCoding 138Agents 135Math –Science 138Reasoning 134101712 GB
30GPT 5.4 (Mar 05, 2026)27 benchmarksCoding 134Agents 132Math 133Science 134Reasoning 13427–
31Qwen3.8 Max21 benchmarksCoding 112Agents 130Math 132Science 129Reasoning 13421–
32Muse Spark 1.322 benchmarksCoding 135Agents 129Math 132Science 138Reasoning 13322–
33Gemini 3.5 Flash26 benchmarksCoding 119Agents 119Math 125Science 126Reasoning 13326–
34DeepSeek V4.1 Flashopen458 GB · 26 benchmarksCoding 122Agents 126Math 129Science 123Reasoning 13326458 GB
35Claude Sonnet 529 benchmarksCoding 126Agents 131Math 132Science 114Reasoning 13329–
36Claude Opus 4.730 benchmarksCoding 130Agents 135Math 130Science 126Reasoning 13230–
37Claude Haiku 5.529 benchmarksCoding 135Agents 137Math 136Science 127Reasoning 13229–
38Grok 4.632 benchmarksCoding 132Agents 135Math 129Science 130Reasoning 13232–
39DeepSeek V4 Pro 0813open991 GB · 21 benchmarksCoding 125Agents –Math 128Science 126Reasoning 13121991 GB
40GLM 5.3open454 GB · 27 benchmarksCoding 130Agents 134Math 129Science 131Reasoning 13027454 GB
41Claude Opus 4.630 benchmarksCoding 123Agents 132Math 128Science 124Reasoning 13030–
42Muse Spark 1.218 benchmarksCoding 122Agents 123Math 128Science 131Reasoning 13018–
43Muse Spark 1.114 benchmarksCoding 118Agents 128Math 127Science 130Reasoning 13014–
44Kimi K3open1670 GB · 31 benchmarksCoding 135Agents 132Math 135Science 136Reasoning 130311670 GB
45Grok 4.2011 benchmarksCoding 116Agents 121Math –Science –Reasoning 13011–
46GPT 5.2 Pro (Dec 11, 2025)6 benchmarksCoding –Agents –Math 132Science –Reasoning 1306–
47Gemini 3.6 Flash24 benchmarksCoding 116Agents 125Math 125Science 125Reasoning 12924–
48Grok 4.727 benchmarksCoding 134Agents 138Math 122Science 130Reasoning 12927–
49DeepSeek V4 Flash 0731open183 GB · 21 benchmarksCoding 121Agents –Math 128Science 124Reasoning 12921183 GB
50GPT 5.6 Luna31 benchmarksCoding 126Agents 127Math 135Science 129Reasoning 12831–
51Muse Spark Open 816B A42Bopen552 GB · 14 benchmarksCoding 128Agents 113Math 128Science 125Reasoning 12814552 GB
52Grok 4.529 benchmarksCoding 127Agents 126Math 125Science 128Reasoning 12829–
53GLM 5.3 Flashopen205 GB · 24 benchmarksCoding 117Agents 128Math 121Science 124Reasoning 12724205 GB
54GPT 6 Luna24 benchmarksCoding 133Agents 130Math 135Science 128Reasoning 12724–
55Qwen3.8 Max (Sep 02)11 benchmarksCoding 133Agents –Math 128Science 127Reasoning 12711–
56Qwen3.7 Max18 benchmarksCoding 122Agents –Math 126Science 122Reasoning 12718–
57GPT 5.2 (Dec 11, 2025)23 benchmarksCoding 126Agents 126Math 124Science 122Reasoning 12723–
58Claude Sonnet 4.627 benchmarksCoding 120Agents 120Math 128Science 108Reasoning 12727–
59Grok 4.20 0309 Reasoning8 benchmarksCoding –Agents –Math 118Science –Reasoning 1268–
60Qwen3.8 27Bopen17.9 GB · 16 benchmarksCoding 118Agents 122Math 118Science 112Reasoning 1241617.9 GB
61Gemini 3 Flash Preview20 benchmarksCoding 124Agents 121Math 120Science –Reasoning 12320–
62DeepSeek V4 Flash Vision Expopen183 GB · 6 benchmarks—Coding 98Agents –Math –Science –Reasoning 1236183 GB
63Inkling Smallopen163 GB · 11 benchmarksCoding –Agents –Math 117Science 118Reasoning 12311163 GB
64Claude Opus 4.5 (Nov 01, 2025)24 benchmarksCoding 119Agents 124Math 118Science 116Reasoning 12224–
65Gemini 3 Pro Preview16 benchmarksCoding 124Agents 127Math 120Science 126Reasoning 12216–
66Grok 4.1 Fast Reasoning6 benchmarksCoding –Agents –Math –Science –Reasoning 1216–
67Mistral Large 4 1T A52Bopen629 GB · 24 benchmarksCoding 119Agents 121Math 122Science 123Reasoning 12124629 GB
68Gemini 3.1 Pro6 benchmarks—Coding 115Agents –Math –Science –Reasoning 1216–
69Inklingopen575 GB · 25 benchmarksCoding 109Agents 110Math 112Science 116Reasoning 12125575 GB
70Qwen3.6 Max Preview8 benchmarksCoding –Agents –Math –Science –Reasoning 1218–
71GLM 5.2open454 GB · 26 benchmarksCoding 120Agents 128Math 126Science 128Reasoning 12026454 GB
72GPT 5 Pro (Oct 06, 2025)8 benchmarksCoding –Agents –Math 123Science –Reasoning 1198–
73GPT 5.1 (Nov 13, 2025)21 benchmarksCoding 120Agents 112Math –Science 116Reasoning 11921–
74Beam 1.0 501B A23Bopen304 GB · 10 benchmarksCoding 123Agents 118Math –Science 120Reasoning 11910304 GB
75DeepSeek V4 Proopen960 GB · 22 benchmarksCoding 111Agents –Math 118Science 122Reasoning 11922960 GB
76Kimi K2.6open618 GB · 21 benchmarksCoding 119Agents 122Math 122Science 121Reasoning 11821618 GB
77GPT 5 (Aug 07, 2025)25 benchmarksCoding 120Agents 113Math 122Science 117Reasoning 11725–
78Grok 4.318 benchmarksCoding 112Agents –Math 117Science 118Reasoning 11718–
79Grok 4 (Jul 09)11 benchmarksCoding 111Agents 103Math –Science –Reasoning 11711–
80Qwen3.5 397B A17Bopen243 GB · 10 benchmarksCoding –Agents –Math 112Science 113Reasoning 11710243 GB
81Claude Opus 4.1 (Aug 05, 2025)14 benchmarksCoding 106Agents 108Math 103Science 105Reasoning 11714–
82GLM 5.1open454 GB · 14 benchmarksCoding 114Agents 123Math 117Science 117Reasoning 11614454 GB
83O3 (Apr 16, 2025)20 benchmarksCoding 114Agents –Math 112Science 110Reasoning 11520–
84Kimi K2.7 Codeopen618 GB · 19 benchmarksCoding 115Agents 119Math 121Science 118Reasoning 11519618 GB
85Claude Sonnet 4.5 (Sep 29, 2025)23 benchmarksCoding 109Agents 115Math 109Science 109Reasoning 11523–
86Kimi K2.5open618 GB · 19 benchmarksCoding 110Agents 110Math –Science 117Reasoning 11519618 GB
87GPT 5.4 Mini (Mar 17, 2026)18 benchmarksCoding 121Agents –Math 120Science 118Reasoning 11518–
88NVIDIA Nemotron 3 Ultra 550B A55B BF16open378 GB · 18 benchmarksCoding 102Agents 101Math 112Science 112Reasoning 11418378 GB
89Qwen3.7 Plus9 benchmarksCoding 103Agents –Math 114Science 117Reasoning 1149–
90MiniMax M2.5open140 GB · 11 benchmarksCoding 109Agents 110Math –Science –Reasoning 11411140 GB
91DeepSeek V3.2 Expopen413 GB · 10 benchmarksCoding 107Agents –Math –Science 101Reasoning 11310413 GB
92O3 Pro (Jun 10, 2025)7 benchmarksCoding 117Agents –Math –Science –Reasoning 1137–
93Qwen3.5 122B A10Bopen75.5 GB · 6 benchmarksCoding –Agents –Math –Science 96Reasoning 112675.5 GB
94DeepSeek V3.2open413 GB · 13 benchmarksCoding –Agents 108Math –Science –Reasoning 11213413 GB
95GPT 5.4 Nano (Mar 17, 2026)17 benchmarksCoding 113Agents –Math 116Science 109Reasoning 11217–
96Gemini 3.5 Flash Lite19 benchmarksCoding 105Agents –Math 106Science 110Reasoning 11219–
97GLM 4.7open218 GB · 13 benchmarksCoding 101Agents 106Math 111Science 111Reasoning 11113218 GB
98GPT 5 Mini (Aug 07, 2025)21 benchmarksCoding 110Agents 103Math 117Science 104Reasoning 11121–
99Gemma 4 31B ITopen21.7 GB · 14 benchmarksCoding 107Agents –Math –Science 105Reasoning 1111421.7 GB
100DeepSeek V4 Flashopen175 GB · 13 benchmarksCoding 114Agents –Math –Science 111Reasoning 11113175 GB
101MiMo V2.5 Proopen616 GB · 6 benchmarksCoding 116Agents –Math –Science 114Reasoning 1116616 GB
102Grok 4 Fast6 benchmarksCoding –Agents –Math –Science –Reasoning 1116–
103Qwen3.5 27Bopen17.9 GB · 6 benchmarksCoding 98Agents –Math –Science –Reasoning 111617.9 GB
104O4 Mini (Apr 16, 2025)20 benchmarksCoding 110Agents –Math 112Science 108Reasoning 11020–
105Qwen3.5 Flash10 benchmarksCoding –Agents –Math 106Science –Reasoning 11010–
106GLM 5open454 GB · 14 benchmarksCoding 110Agents 118Math –Science –Reasoning 11014454 GB
107Qwen3.6 Plus16 benchmarksCoding 108Agents –Math 115Science 114Reasoning 10916–
108MiniMax M3open258 GB · 22 benchmarksCoding 114Agents 111Math 106Science 118Reasoning 10922258 GB
109Qwen3.5 Plus11 benchmarksCoding –Agents –Math –Science –Reasoning 10911–
110Claude Opus 4 (May 14, 2025)13 benchmarksCoding 107Agents –Math –Science 104Reasoning 10813–
111Claude Haiku 4.5 (Oct 01, 2025)17 benchmarksCoding 105Agents 104Math –Science 101Reasoning 10817–
112Gemini 2.5 Pro16 benchmarksCoding 112Agents 102Math 109Science 113Reasoning 10816–
113DeepSeek V3.1 Terminusopen412 GB · 5 benchmarksCoding 107Agents –Math –Science 99Reasoning 1085412 GB
114Qwen3 235B A22B Thinking 2507open143 GB · 13 benchmarksCoding 102Agents –Math –Science 108Reasoning 10813143 GB
115Tiny Recursion Model2 benchmarks—Coding –Agents –Math –Science –Reasoning 1072–
116Gemini 3.1 Flash Lite11 benchmarksCoding 111Agents –Math 109Science 108Reasoning 10711–
117Claude Sonnet 4 (May 14, 2025)16 benchmarksCoding 104Agents –Math –Science 104Reasoning 10716–
118Qwen3 Max (Sep 23, 2025)11 benchmarksCoding –Agents –Math 105Science –Reasoning 10711–
119Qwen3.5 35B A3Bopen22.0 GB · 8 benchmarksCoding 86Agents –Math –Science 108Reasoning 107822.0 GB
120Gemini 2.5 Pro Preview (Mar 25)5 benchmarksCoding –Agents –Math –Science –Reasoning 1065–

The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.

Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.

VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.

How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.

Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.