llmrun Composite Score
The best open LLMs: every open model we can rank, on one open-ended quality scale fitted across public leaderboards, where 100 is the average model. Filter to the models that fit your GPU.
40 benchmarks4 sourcesUpdated 10 Oct 2026Reference scale 2026-Q4How the Composite Score is built
Composite Score vs VRAM needed
This chart doesn't show proprietary models.
| # (open / overall) | Model | llmrun Composite Score | Coding | Agents | Math | Science | Reasoning | Benchmarks | VRAM |
|---|---|---|---|---|---|---|---|---|---|
| 1 / 72 | Qwen3.8 27B17.9 GB · 12 benchmarks | 112 | – | 118 | 112 | 124 | 12 | 17.9 GB | |
| 2 / 98 | Qwen3.6 27B17.9 GB · 12 benchmarks | 102 | – | 114 | 111 | 106 | 12 | 17.9 GB | |
| 3 / 124 | Qwen3.6 35B A3B22.0 GB · 12 benchmarks | 105 | – | 109 | 110 | 107 | 12 | 22.0 GB | |
| 4 / 128 | Gemma 4 31B IT21.7 GB · 11 benchmarks | 108 | – | – | 105 | 109 | 11 | 21.7 GB | |
| 5 / 131 | Qwen3.5 35B A3B22.0 GB · 8 benchmarks | – | – | – | 108 | 106 | 8 | 22.0 GB | |
| 6 / 132 | Gemma 4 26B A4B IT16.5 GB · 9 benchmarks | 104 | – | – | 102 | 101 | 9 | 16.5 GB | |
| 7 / 142 | Qwen3.5 27B17.9 GB · 6 benchmarks | 98 | – | – | – | 111 | 6 | 17.9 GB | |
| 8 / 153 | Qwen3 30B A3B Thinking 250719.4 GB · 8 benchmarks | – | – | – | 99 | 94 | 8 | 19.4 GB | |
| 9 / 160 | Qwen3.5 9B6.6 GB · 9 benchmarks | – | – | – | 104 | 97 | 9 | 6.6 GB | |
| 10 / 163 | Qwen3 32B22.6 GB · 9 benchmarks | 93 | – | – | 96 | 91 | 9 | 22.6 GB | |
| 11 / 166 | Qwen3 14B11.9 GB · 8 benchmarks | – | – | – | 94 | 88 | 8 | 11.9 GB | |
| 12 / 169 | Qwen3 30B A3B Instruct 250719.4 GB · 5 benchmarks | – | – | – | – | 92 | 5 | 19.4 GB | |
| 13 / 171 | GPT OSS 20B13.1 GB · 11 benchmarks | 101 | – | – | 92 | 91 | 11 | 13.1 GB | |
| 14 / 177 | Qwen3 8B7.6 GB · 8 benchmarks | – | – | – | 88 | 81 | 8 | 7.6 GB | |
| 15 / 178 | Qwen3 30B A3B19.4 GB · 7 benchmarks | – | – | – | – | 83 | 7 | 19.4 GB | |
| 16 / 193 | Magistral Small 250617.8 GB · 4 benchmarks | – | – | – | – | 88 | 4 | 17.8 GB | |
| 17 / 197 | Mistral Small 3.2 24B Instruct 250618.1 GB · 6 benchmarks | – | – | – | 82 | 83 | 6 | 18.1 GB | |
| 18 / 198 | Magistral Small 250918.1 GB · 6 benchmarks | – | – | – | 83 | 85 | 6 | 18.1 GB | |
| 19 / 201 | Phi 412.5 GB · 5 benchmarks | – | – | – | – | – | 5 | 12.5 GB | |
| 20 / 215 | Gemma 3 27B IT21.7 GB · 10 benchmarks | 69 | – | – | 80 | 74 | 10 | 21.7 GB | |
| 21 / 217 | Mistral Small 3.1 24B Instruct 250318.1 GB · 6 benchmarks | – | – | – | 81 | 82 | 6 | 18.1 GB | |
| 22 / 223 | Gemma 3 12B IT10.9 GB · 8 benchmarks | – | – | – | 72 | 66 | 8 | 10.9 GB | |
| 23 / 230 | Mistral Nemo Instruct 240711.0 GB · 4 benchmarks | – | – | – | – | – | 4 | 11.0 GB | |
| 24 / 233 | Qwen2.5 7B Instruct5.8 GB · 6 benchmarks | – | – | – | – | 65 | 6 | 5.8 GB | |
| 25 / 234 | Gemma 3 4B IT5.0 GB · 6 benchmarks | – | – | – | – | 69 | 6 | 5.0 GB | |
| 26 / 235 | Llama 3.1 8B Instruct7.9 GB · 10 benchmarks | 56 | – | – | 56 | 69 | 10 | 7.9 GB | |
| 27 / 236 | Meta Llama 3 8B Instruct7.9 GB · 6 benchmarks | – | – | – | – | 64 | 6 | 7.9 GB | |
| 28 / 237 | Llama 3.2 1B Instruct2.3 GB · 4 benchmarks | – | – | – | – | – | 4 | 2.3 GB | |
| 29 / 240 | Gemma 3 1B IT2.1 GB · 4 benchmarks | – | – | – | – | – | 4 | 2.1 GB |
The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.
Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.
VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.
How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.