Devstral 2 123B Instruct 2512 — Benchmarks

Benchmark scores for Devstral 2 123B Instruct 2512 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

No overall rank for Devstral 2 123B Instruct 2512: an overall score is only published when a model has been measured on enough of the benchmarks current models are still submitted to. Its individual scores below stand on their own — see the methodology for how the overall score is built.

Coding

BenchmarkScoreOpen rankAll models
LMArena WebDev1194.2#47 / 48#118 / 123
SWE-bench Verified53.8%#15 / 20#88 / 162

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.