llmrun

llmrun Composite Score

The best LLMs, open and proprietary together, on one open-ended scale where 100 is the average model (overall capability). Switch to open models to see only what you can download and run.

46 benchmarks4 sourcesUpdated 14 Nov 2026Reference scale 2026-Q4How the Composite Score is built

Composite Score vs VRAM needed

This chart doesn't show proprietary models.

Models ranked by overall llmrun Composite Score
#Modelllmrun Composite ScoreCodingAgentsMathScienceReasoningBenchmarksVRAM
241Mistral Large 24023 benchmarksCoding –Agents –Math –Science –Reasoning –3–
242Gemini 1.5 Flash 0014 benchmarksCoding –Agents –Math –Science –Reasoning 744–
243Gemma 2 27B ITopen19.5 GB · 3 benchmarksCoding –Agents –Math –Science –Reasoning –319.5 GB
244Claude 3 Sonnet (Feb 29, 2024)4 benchmarksCoding –Agents –Math –Science –Reasoning –4–
245Mixtral 8x22B Instruct v0.1open88.4 GB · 5 benchmarksCoding –Agents –Math –Science –Reasoning 78588.4 GB
246GPT 4o Mini (Jul 18, 2024)13 benchmarksCoding 68Agents –Math 76Science –Reasoning 7313–
247Gemma 2 9B ITopen7.3 GB · 3 benchmarksCoding –Agents –Math –Science –Reasoning –37.3 GB
248Claude 2.15 benchmarksCoding –Agents –Math –Science –Reasoning 735–
249Claude 3 Haiku (Mar 07, 2024)6 benchmarksCoding –Agents –Math –Science –Reasoning 676–
250Mixtral 8x7B Instruct v0.1open30.5 GB · 4 benchmarksCoding –Agents –Math –Science –Reasoning 71430.5 GB
251Mistral Nemo Instruct 2407open11.0 GB · 4 benchmarksCoding –Agents –Math –Science –Reasoning –411.0 GB
252Qwen2.5 7B Instructopen5.8 GB · 5 benchmarksCoding –Agents –Math –Science –Reasoning 6555.8 GB
253Gemma 3 4B ITopen5.0 GB · 5 benchmarksCoding –Agents –Math –Science –Reasoning 6955.0 GB
254Llama 3.1 8B Instructopen7.9 GB · 9 benchmarksCoding 56Agents –Math –Science 56Reasoning 7097.9 GB
255Meta Llama 3 8B Instructopen7.9 GB · 5 benchmarksCoding –Agents –Math –Science –Reasoning 6557.9 GB
256GPT 3.5 Turbo (Jan 25)8 benchmarksCoding –Agents –Math 72Science –Reasoning 368–
257Llama 2 70B Chat HFopen50.2 GB · 4 benchmarksCoding –Agents –Math –Science –Reasoning 42450.2 GB

The range after each score is a 90% interval: given the boards a model has results on, its true score is very likely inside it. Short ranges mean many agreeing results; long ranges mean few or conflicting ones.

Why some models are missing. A model receives a score only if it has results on at least 4 benchmarks across at least 2 categories, with one being reasoning or coding, or on 3 benchmarks that narrow its 90% range to at most 15.6 points. The results must come from at least two different benchmarks: categories of one benchmark, such as LiveBench, count once. Skill scores require at least 2 benchmarks for that skill; otherwise they display as –.

VRAM is llmrun's estimate at Q4_K_M (or the smallest quantization we track) for the weights plus room for a 16K-token context. Longer contexts need more memory. Proprietary models can't run locally, so the VRAM filter hides them.

How the llmrun Composite Score is built · llmrun doesn't run these benchmarks; scores come from public sources.

Dataset. Grab the scores of every open model as a dataset on Hugging Face, including a timestamped snapshot for each refresh.