What is the best open LLM on LiveBench Reasoning?

Kimi K3 is the top open model on LiveBench Reasoning, scoring 90.7. Among all models tested — including proprietary ones — it ranks #5. The top model overall is GPT 6 Astra Max (OpenAI) at 92.7.

What's the best LiveBench Reasoning model you can run on a 24 GB GPU?

Qwen3.8 27B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (about 15 GB), scoring 80.0 on LiveBench Reasoning.

Can open models match proprietary models on LiveBench Reasoning?

Not quite on LiveBench Reasoning: the strongest proprietary model (GPT 6 Astra Max) scores 92.7, ahead of the best open model (Kimi K3) at 90.7 — but you can run the open one yourself.

Reasoning

LiveBench Reasoning Leaderboard

Name: LiveBench Reasoning — open LLM scores
Creator: livebench

LiveBench Reasoning measures logical, multi-step reasoning using contamination-free questions that are refreshed regularly, so models cannot have trained on the test set.

Source: livebench16 open models ranked+38 proprietaryData through Jun 2026

Open models All models

Open models ranked on LiveBench Reasoning

# shows rank among open models / rank overall (including proprietary).

#	Model	Score
1 / 5	Kimi K3 · 2779.9B	90.7
2 / 21	Qwen3.8 Flash Next · 180.0B	87.4
3 / 24	DeepSeek V4 Flash 0731 · 304.2B	86.6
4 / 25	DeepSeek V4 Pro 0813 · 1650.5B	85.8
5 / 26	GLM 5.3 · 753.3B	85.8
6 / 34	Kimi K2.7 Code · 1026.9B	82.8
7 / 35	DeepSeek V4 Pro · 1598.8B	82.7
8 / 39	Qwen3.8 27B · 27.8B	80.0
9 / 40	Kimi K2.6 · 1026.9B	79.4
10 / 41	GLM 5.2 · 753.3B	78.6
11 / 42	Inkling · 952.4B	78.3
12 / 44	GLM 5.3 Flash · 321.3B	77.6
13 / 48	NVIDIA Nemotron 3 Ultra 550B A55B BF16 · 560.5B	74.7
14 / 49	MiniMax M3 · 427.0B	74.5
15 / 52	DeepSeek V4 Flash · 290.9B	70.6
16 / 53	Qwen3.6 27B · 27.8B	70.3

Score vs model size

Which models give the most quality for their size — the ones worth running locally.

Each dot is a model. Up = higher score, left = smaller (easier to run locally). The dashed line marks the efficiency frontier — the best score you can get at each size or smaller.

LiveBench Reasoning: frequently asked questions

What is the best open LLM on LiveBench Reasoning?: Kimi K3 is the top open model on LiveBench Reasoning, scoring 90.7. Among all models tested — including proprietary ones — it ranks #5. The top model overall is GPT 6 Astra Max (OpenAI) at 92.7.
What's the best LiveBench Reasoning model you can run on a 24 GB GPU?: Qwen3.8 27B is the highest-scoring open model that fits in 24 GB at 4-bit quantization (about 15 GB), scoring 80.0 on LiveBench Reasoning.
Can open models match proprietary models on LiveBench Reasoning?: Not quite on LiveBench Reasoning: the strongest proprietary model (GPT 6 Astra Max) scores 92.7, ahead of the best open model (Kimi K3) at 90.7 — but you can run the open one yourself.

Scores aggregated from livebench. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.