What is the best open LLM on GDP.pdf?

DeepSeek V4.1 Flash is the top open model on GDP.pdf, scoring 19.8%. Among all models tested — including proprietary ones — it ranks #31. The top model overall is GPT 6.1 Sol Max (OpenAI) at 35.0%.

Can open models match proprietary models on GDP.pdf?

Not quite on GDP.pdf: the strongest proprietary model (GPT 6.1 Sol Max) scores 35.0%, ahead of the best open model (DeepSeek V4.1 Flash) at 19.8% — but you can run the open one yourself.

Reasoning

GDP.pdf Leaderboard

Name: GDP.pdf — open LLM scores
Creator: epoch

GDP.pdf, from Surge AI, tests whether a model can carry out professional document-production work and deliver the result as a PDF. The score is a 0–1 fraction (higher is better), shown as redistributed by Epoch AI.

Source: epoch4 open models ranked+52 proprietaryData through Oct 2026

Open models All models

Open models ranked on GDP.pdf

# shows rank among open models / rank overall (including proprietary).

#	Model	Score	VRAM @ Q4
1 / 31	DeepSeek V4.1 Flash · 763.2B	19.8%	~458 GB
2 / 32	Kimi K3 · 2779.9B	19.0%	~1674 GB
3 / 46	GLM 5.3 Flash · 321.3B	14.0%	~195 GB
4 / 48	Kimi K2.6 · 1026.9B	12.0%	~620 GB

GDP.pdf: frequently asked questions

What is the best open LLM on GDP.pdf?: DeepSeek V4.1 Flash is the top open model on GDP.pdf, scoring 19.8%. Among all models tested — including proprietary ones — it ranks #31. The top model overall is GPT 6.1 Sol Max (OpenAI) at 35.0%.
Can open models match proprietary models on GDP.pdf?: Not quite on GDP.pdf: the strongest proprietary model (GPT 6.1 Sol Max) scores 35.0%, ahead of the best open model (DeepSeek V4.1 Flash) at 19.8% — but you can run the open one yourself.

Scores aggregated from epoch. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.