Mistral Small 24B Instruct 2501 — Benchmarks

Benchmark scores for Mistral Small 24B Instruct 2501 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

No overall rank for Mistral Small 24B Instruct 2501: an overall score is only published when a model has been measured on enough of the benchmarks current models are still submitted to. Its individual scores below stand on their own — see the methodology for how the overall score is built.

Instruction Following

BenchmarkScoreOpen rankAll models
LMArena Text1274.3#116 / 182#284 / 391

Math

BenchmarkScoreOpen rankAll models
MATH Level 544.8%#18 / 39#69 / 107
AIME 2024/20256.7%#64 / 82#232 / 270

Reasoning

BenchmarkScoreOpen rankAll models
Chess Puzzles0.0%#60 / 65#200 / 205
GPQA Diamond47.3%#59 / 94#228 / 289

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.