DeepSeek v3 0324 — Benchmarks
Benchmark scores for DeepSeek v3 0324 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Overall rank: #20 of 73 open modelscomposite 56.6/100 across 7 benchmarks in 4 categories · methodology
Coding
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| SWE-bench Verified | 42.0% | #12 / 13 | #117 / 163 |
| Aider Polyglot | 55.1% | #8 / 18 | #33 / 69 |
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MMLU-Pro | 81.3% | #18 / 119 | #57 / 259 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| AIME 2024/2025 | 37.8% | #14 / 34 | #96 / 155 |
| MATH Level 5 | 75.5% | #5 / 32 | #40 / 108 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| SimpleBench | 27.2% | #14 / 19 | #73 / 90 |
| GPQA Diamond | 67.6% | #14 / 46 | #91 / 182 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.