Reasoning
Furniture Assembly Leaderboard
Furniture Assembly, built by Epoch AI, tests spatial reasoning with 60 photos of partly built IKEA furniture and the assembly manual: the model must say whether the build is correct so far and, if not, name the mistaken step and describe the error. Scores are accuracy across the photos, and a human baseline averaged 63%.
Source: epoch3 open models ranked+31 proprietaryData through Oct 2026
Open models ranked on Furniture Assembly
# shows rank among open models / rank overall (including proprietary).
| # | Model | Score | VRAM @ Q4 |
|---|---|---|---|
| 1 / 21 | DeepSeek V4.1 Flash · 763.2B | 34.2% | ~458 GB |
| 2 / 22 | Kimi K3 · 2779.9B | 34.2% | ~1674 GB |
| 3 / 31 | Kimi K2.6 · 1026.9B | 21.7% | ~620 GB |
Furniture Assembly: frequently asked questions
- What is the best open LLM on Furniture Assembly?
- DeepSeek V4.1 Flash is the top open model on Furniture Assembly, scoring 34.2%. Among all models tested — including proprietary ones — it ranks #21. The top model overall is Claude Opus 5.5 Max (Anthropic) at 83.3%.
- Can open models match proprietary models on Furniture Assembly?
- Not quite on Furniture Assembly: the strongest proprietary model (Claude Opus 5.5 Max) scores 83.3%, ahead of the best open model (DeepSeek V4.1 Flash) at 34.2% — but you can run the open one yourself.
Scores aggregated from epoch. llmrun does not run this benchmark — see the source for methodology, or the about benchmarks for what it measures.