Mistral Small 24B Instruct 2501 — Benchmarks
Benchmark scores for Mistral Small 24B Instruct 2501 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
No overall rank for Mistral Small 24B Instruct 2501: an overall score is only published when a model has been measured on enough of the benchmarks current models are still submitted to. Its individual scores below stand on their own — see the methodology for how the overall score is built.
Instruction Following
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| LMArena Text | 1274.3 | #116 / 182 | #284 / 391 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MATH Level 5 | 44.8% | #18 / 39 | #69 / 107 |
| AIME 2024/2025 | 6.7% | #64 / 82 | #232 / 270 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| Chess Puzzles | 0.0% | #60 / 65 | #200 / 205 |
| GPQA Diamond | 47.3% | #59 / 94 | #228 / 289 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.