llmrun

llmrun Composite Score

The best LLMs, open and proprietary together, on one open-ended scale where 100 is the average model (overall capability). Switch to open models to see only what you can download and run.

46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built

Composite Score vs VRAM needed

This chart doesn't show proprietary models.

Models ranked by overall llmrun Composite Score
#Modelllmrun Composite ScoreCodingAgentsMathScienceReasoningBenchmarksVRAM
1Claude Fable 5.221 benchmarksCoding 156Agents 161Math 154Science 148Reasoning 16521–
2Gemini 4 Carbon18 benchmarksCoding –Agents 163Math 149Science 147Reasoning 15518–
3GPT 6 Astra34 benchmarksCoding 156Agents 158Math 153Science 146Reasoning 15734–
4Claude Opus 5.529 benchmarksCoding 149Agents 152Math 151Science 144Reasoning 15529–
5GPT 6.1 Sol27 benchmarksCoding 152Agents 148Math 154Science 141Reasoning 15527–
6GPT 6.1 Terra17 benchmarksCoding 153Agents 146Math 148Science 138Reasoning 15317–
7Gemini 4 Argon26 benchmarksCoding 143Agents 152Math 145Science 140Reasoning 15026–
8Claude Sonnet 5.529 benchmarksCoding 142Agents 152Math 146Science 143Reasoning 15129–
9Claude Fable 5.132 benchmarksCoding 148Agents 148Math 148Science 143Reasoning 14832–
10GPT 6 Sol27 benchmarksCoding 148Agents 148Math 145Science 141Reasoning 14427–
11GPT 5.6 Sol Pro8 benchmarksCoding –Agents –Math –Science –Reasoning 1508–
12Claude Opus 533 benchmarksCoding 147Agents 145Math 143Science 139Reasoning 14533–
13GPT 5.6 Sol34 benchmarksCoding 145Agents 142Math 143Science 142Reasoning 14434–
14GPT 5.5 Pro9 benchmarksCoding –Agents –Math 142Science –Reasoning 1429–
15Claude Fable 533 benchmarksCoding 148Agents 141Math 148Science 138Reasoning 13933–
16Muse Wonder 1.020 benchmarksCoding 132Agents 139Math 140Science 141Reasoning 14220–
17Kimi K3.1 Proopen1712 GB · 10 benchmarksCoding 138Agents 135Math –Science 138Reasoning 134101712 GB
18Kimi K3.1 Pro Together Max8 benchmarksCoding –Agents –Math 137Science –Reasoning 1428–
19GPT 5.535 benchmarksCoding 140Agents 136Math 136Science 136Reasoning 14135–
20GPT 5.6 Terra31 benchmarksCoding 138Agents 136Math 139Science 139Reasoning 13831–
21GPT 5.4 Pro (Mar 05, 2026)10 benchmarksCoding –Agents –Math 136Science 141Reasoning 14210–
22Gemini 3 Deep Think Preview3 benchmarksCoding –Agents –Math –Science –Reasoning 1373–
23Claude Haiku 5.529 benchmarksCoding 135Agents 137Math 136Science 127Reasoning 13229–
24Inkling 2 Smallopen359 GB · 4 benchmarksCoding –Agents –Math –Science –Reasoning 1364359 GB
25Claude Opus 4.832 benchmarksCoding 136Agents 132Math 136Science 129Reasoning 13532–
26DeepSeek V4.1 Flash 1017open458 GB · 17 benchmarksCoding 135Agents 137Math 132Science 134Reasoning 13717458 GB
27MiMo V2.6 Pro RLopen614 GB · 8 benchmarksCoding 125Agents 132Math –Science 140Reasoning –8614 GB
28GPT 5.4 (Mar 05, 2026)27 benchmarksCoding 134Agents 132Math 133Science 134Reasoning 13427–
29GPT 5.3 Codex5 benchmarksCoding 134Agents 132Math –Science –Reasoning –5–
30Kimi K3open1670 GB · 31 benchmarksCoding 135Agents 132Math 135Science 136Reasoning 130311670 GB
31Muse Spark 1.322 benchmarksCoding 135Agents 129Math 132Science 138Reasoning 13322–
32Gemini 3.7 Flash27 benchmarksCoding 124Agents 130Math 131Science 129Reasoning 13627–
33Gemini 3.8 Flash32 benchmarksCoding 131Agents 131Math 128Science 136Reasoning 13832–
34MiMo V2.6 Flash RLopen187 GB · 4 benchmarksCoding 124Agents –Math –Science 122Reasoning –4187 GB
35GPT 6 Luna24 benchmarksCoding 133Agents 130Math 135Science 128Reasoning 12724–
36Grok 4.632 benchmarksCoding 132Agents 135Math 129Science 130Reasoning 13232–
37Claude Opus 4.730 benchmarksCoding 130Agents 135Math 130Science 126Reasoning 13230–
38Qwen3.8 Max21 benchmarksCoding 112Agents 130Math 132Science 129Reasoning 13421–
39GPT 5.2 Pro (Dec 11, 2025)6 benchmarksCoding –Agents –Math 132Science –Reasoning 1306–
40GPT 5.6 Luna31 benchmarksCoding 126Agents 127Math 135Science 129Reasoning 12831–
41Claude Sonnet 529 benchmarksCoding 126Agents 131Math 132Science 114Reasoning 13329–
42GLM 5.3open454 GB · 27 benchmarksCoding 130Agents 134Math 129Science 131Reasoning 13027454 GB
43DeepSeek V4.1 Flashopen458 GB · 26 benchmarksCoding 122Agents 126Math 129Science 123Reasoning 13326458 GB
44DeepSeek V4 Pro 0813open991 GB · 21 benchmarksCoding 125Agents –Math 128Science 126Reasoning 13121991 GB
45Claude Opus 4.630 benchmarksCoding 123Agents 132Math 128Science 124Reasoning 13030–
46Qwen3.8 Max (Sep 02)11 benchmarksCoding 133Agents –Math 128Science 127Reasoning 12711–
47Grok 4.727 benchmarksCoding 134Agents 138Math 122Science 130Reasoning 12927–
48Doubao Seed Evolving4 benchmarksCoding –Agents –Math –Science –Reasoning –4–
49Step 5 Previewopen408 GB · 3 benchmarksCoding –Agents –Math –Science 134Reasoning –3408 GB
50Gemini 3.1 Pro Preview30 benchmarksCoding 126Agents 119Math 124Science 137Reasoning 13530–
51DeepSeek V4 Flash 0731open183 GB · 21 benchmarksCoding 121Agents –Math 128Science 124Reasoning 12921183 GB
52Gemini 3.5 Flash26 benchmarksCoding 119Agents 119Math 125Science 126Reasoning 13326–
53Muse Spark 1.114 benchmarksCoding 118Agents 128Math 127Science 130Reasoning 13014–
54Muse Spark Open 816B A42Bopen552 GB · 14 benchmarksCoding 128Agents 113Math 128Science 125Reasoning 12814552 GB
55Muse Spark 1.218 benchmarksCoding 122Agents 123Math 128Science 131Reasoning 13018–
56Grok 4.2011 benchmarksCoding 116Agents 121Math –Science –Reasoning 13011–
57Gemini 3.6 Flash24 benchmarksCoding 116Agents 125Math 125Science 125Reasoning 12924–
58Grok 4.529 benchmarksCoding 127Agents 126Math 125Science 128Reasoning 12829–
59Qwen3.7 Max18 benchmarksCoding 122Agents –Math 126Science 122Reasoning 12718–
60GPT 5.2 (Dec 11, 2025)23 benchmarksCoding 126Agents 126Math 124Science 122Reasoning 12723–
61Claude Sonnet 4.627 benchmarksCoding 120Agents 120Math 128Science 108Reasoning 12727–
62GLM 5.3 Flashopen205 GB · 24 benchmarksCoding 117Agents 128Math 121Science 124Reasoning 12724205 GB
63Gemini 3 Pro Preview16 benchmarksCoding 124Agents 127Math 120Science 126Reasoning 12216–
64GLM 5.2open454 GB · 26 benchmarksCoding 120Agents 128Math 126Science 128Reasoning 12026454 GB
65Qwen3.6 Max Preview8 benchmarksCoding –Agents –Math –Science –Reasoning 1218–
66Gemini 3 Flash Preview20 benchmarksCoding 124Agents 121Math 120Science –Reasoning 12320–
67Qwen3.8 27Bopen17.9 GB · 16 benchmarksCoding 118Agents 122Math 118Science 112Reasoning 1241617.9 GB
68GPT 5.2 Codex8 benchmarksCoding 124Agents 121Math –Science –Reasoning –8–
69Claude Opus 4.5 (Nov 01, 2025)24 benchmarksCoding 119Agents 124Math 118Science 116Reasoning 12224–
70Kimi K2.6open618 GB · 21 benchmarksCoding 119Agents 122Math 122Science 121Reasoning 11821618 GB
71Mistral Large 4 1T A52Bopen629 GB · 24 benchmarksCoding 119Agents 121Math 122Science 123Reasoning 12124629 GB
72Doubao Seed 2.1 Pro 2606284 benchmarksCoding –Agents –Math –Science –Reasoning –4–
73GPT 5 Pro (Oct 06, 2025)8 benchmarksCoding –Agents –Math 123Science –Reasoning 1198–
74Muse Spark6 benchmarksCoding –Agents –Math 118Science 128Reasoning –6–
75Inkling Smallopen163 GB · 11 benchmarksCoding –Agents –Math 117Science 118Reasoning 12311163 GB
76Beam 1.0 501B A23Bopen304 GB · 10 benchmarksCoding 123Agents 118Math –Science 120Reasoning 11910304 GB
77GPT 5 (Aug 07, 2025)25 benchmarksCoding 120Agents 113Math 122Science 117Reasoning 11725–
78Grok 4.20 0309 Reasoning8 benchmarksCoding –Agents –Math 118Science –Reasoning 1268–
79GPT 5.1 Codex Max3 benchmarksCoding –Agents –Math –Science –Reasoning –3–
80GPT 5.1 (Nov 13, 2025)21 benchmarksCoding 120Agents 112Math –Science 116Reasoning 11921–
81Doubao Seed 2.0 Pro 2602154 benchmarksCoding –Agents –Math –Science –Reasoning –4–
82Kimi K2.7 Codeopen618 GB · 19 benchmarksCoding 115Agents 119Math 121Science 118Reasoning 11519618 GB
83Doubao Seed 2.1 Turbo 2606284 benchmarksCoding –Agents –Math –Science –Reasoning –4–
84GLM 5.1open454 GB · 14 benchmarksCoding 114Agents 123Math 117Science 117Reasoning 11614454 GB
85GPT 5.4 Mini (Mar 17, 2026)18 benchmarksCoding 121Agents –Math 120Science 118Reasoning 11518–
86DeepSeek V4 Proopen960 GB · 22 benchmarksCoding 111Agents –Math 118Science 122Reasoning 11922960 GB
87MiMo V2.5 Proopen616 GB · 6 benchmarksCoding 116Agents –Math –Science 114Reasoning 1116616 GB
88Inklingopen575 GB · 25 benchmarksCoding 109Agents 110Math 112Science 116Reasoning 12125575 GB
89Doubao Seed 2.0 Lite 2604284 benchmarksCoding –Agents –Math –Science –Reasoning –4–
90Grok 4.318 benchmarksCoding 112Agents –Math 117Science 118Reasoning 11718–
91Qwen3.6 Plus16 benchmarksCoding 108Agents –Math 115Science 114Reasoning 10916–
92O3 (Apr 16, 2025)20 benchmarksCoding 114Agents –Math 112Science 110Reasoning 11520–
93O3 Pro (Jun 10, 2025)7 benchmarksCoding 117Agents –Math –Science –Reasoning 1137–
94DeepSeek V4 Flashopen175 GB · 13 benchmarksCoding 114Agents –Math –Science 111Reasoning 11113175 GB
95Grok 4 (Jul 09)11 benchmarksCoding 111Agents 103Math –Science –Reasoning 11711–
96Qwen3.7 Plus9 benchmarksCoding 103Agents –Math 114Science 117Reasoning 1149–
97Kimi K2.5open618 GB · 19 benchmarksCoding 110Agents 110Math –Science 117Reasoning 11519618 GB
98Claude Sonnet 4.5 (Sep 29, 2025)23 benchmarksCoding 109Agents 115Math 109Science 109Reasoning 11523–
99Qwen3.5 397B A17Bopen243 GB · 10 benchmarksCoding –Agents –Math 112Science 113Reasoning 11710243 GB
100MiniMax M3open258 GB · 22 benchmarksCoding 114Agents 111Math 106Science 118Reasoning 10922258 GB
101GPT 5.4 Nano (Mar 17, 2026)17 benchmarksCoding 113Agents –Math 116Science 109Reasoning 11217–
102DeepSeek Reasoner3 benchmarksCoding –Agents –Math –Science –Reasoning –3–
103MiniMax M2.5open140 GB · 11 benchmarksCoding 109Agents 110Math –Science –Reasoning 11411140 GB
104GLM 5open454 GB · 14 benchmarksCoding 110Agents 118Math –Science –Reasoning 11014454 GB
105Qwen3.6 27Bopen17.9 GB · 11 benchmarksCoding 102Agents –Math 114Science 111Reasoning 1051117.9 GB
106Grok 4.1 Fast Reasoning6 benchmarksCoding –Agents –Math –Science –Reasoning 1216–
107Grok 4 Fast6 benchmarksCoding –Agents –Math –Science –Reasoning 1116–
108GPT 5 Mini (Aug 07, 2025)21 benchmarksCoding 110Agents 103Math 117Science 104Reasoning 11121–
109DeepSeek V3.2open413 GB · 13 benchmarksCoding –Agents 108Math –Science –Reasoning 11213413 GB
110O4 Mini (Apr 16, 2025)20 benchmarksCoding 110Agents –Math 112Science 108Reasoning 11020–
111Qwen3.5 Plus11 benchmarksCoding –Agents –Math –Science –Reasoning 10911–
112Qwen3.5 122B A10Bopen75.5 GB · 6 benchmarksCoding –Agents –Math –Science 96Reasoning 112675.5 GB
113Gemini 2.5 Pro Preview (Jun 05)8 benchmarksCoding –Agents –Math –Science 114Reasoning 1068–
114Qwen3.7 Flash4 benchmarksCoding –Agents –Math 109Science –Reasoning –4–
115Gemini 3.5 Flash Lite19 benchmarksCoding 105Agents –Math 106Science 110Reasoning 11219–
116NVIDIA Nemotron 3 Ultra 550B A55B BF16open378 GB · 18 benchmarksCoding 102Agents 101Math 112Science 112Reasoning 11418378 GB
117GLM 4.7open218 GB · 13 benchmarksCoding 101Agents 106Math 111Science 111Reasoning 11113218 GB
118Gemini 2.5 Pro Exp (Mar 25)6 benchmarksCoding –Agents –Math –Science 112Reasoning –6–
119DeepSeek V3.2 Expopen413 GB · 10 benchmarksCoding 107Agents –Math –Science 101Reasoning 11310413 GB
120Gemini 3.1 Flash Lite11 benchmarksCoding 111Agents –Math 109Science 108Reasoning 10711–

The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.

Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.

VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.

How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.

Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.