Mistral Small 3.1 24B Instruct 2503 — Benchmarks
Benchmark scores for Mistral Small 3.1 24B Instruct 2503 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Overall rank: #70 of 78 open modelscomposite 22.7/100 across 7 benchmarks in 3 categories · methodology
Coding
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| SciCode | 26.5% | #52 / 62 | #149 / 161 |
Instruction Following
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| LMArena Text | 1303.1 | #101 / 182 | #261 / 391 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MATH Level 5 | 46.8% | #16 / 39 | #65 / 107 |
| AIME 2024/2025 | 5.8% | #65 / 82 | #238 / 270 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| Chess Puzzles | 1.0% | #43 / 65 | #179 / 205 |
| DTBench | 58.6% | #51 / 67 | #172 / 210 |
| GPQA Diamond | 47.5% | #57 / 94 | #225 / 289 |
| CritPt | 0.0% | #56 / 62 | #162 / 172 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.