Devstral 2 123B Instruct 2512 — Benchmarks

Benchmark scores for Devstral 2 123B Instruct 2512 aggregated from public leaderboards (2 boards), with how it ranks among open models and how it compares with its nearest neighbours. See hardware requirements for what you need to run it.

No llmrun Composite Score for Devstral 2 123B Instruct 2512: the score is only published for a model measured on at least 4 of the boards in the score panel, spanning at least 2 benchmark categories and including a reasoning or coding board — or on 3 boards that narrow its score to a 90% range of at most 15.6 points. Either way the results must come from at least two different benchmarks. Its individual scores below stand on their own — see how the llmrun Composite Score gets calculated.

Devstral 2 123B Instruct 2512 coding benchmarks

Writing, editing, and fixing real code — measured by whether the resulting program actually runs and passes tests.

SWE-bench Verified
SWE-bench Verified tests whether a model can resolve real GitHub issues from popular open-source Python projects, scored on the official swebench.com leaderboard as the percentage of human-validated issues actually fixed. It is the headline measure of practical, agentic software-engineering ability — where open-weight models like Qwen3-Coder, GLM-4.6, Kimi K2 and DeepSWE are now competitive with the frontier.
53.8%
53.8%
median 62.2%open leader 75.8%
Overall best: live-SWE-agent + Claude 4.5 Opus medium (20251101) 79.2%
26th percentile · #15 of 20 open · #88 of 162 all
#15 of 20
#88 of 162
Independent
SWE-bench · Dec 2025

Other results (1)leaderboard-only, not part of the llmrun Score

Leaderboard-only, not part of the llmrun Score

LMArena WebDev
Code Arena (formerly WebDev Arena) is Arena's head-to-head coding leaderboard: two models each build a real web app or UI from the same prompt, and people vote blind on which result is better. The rating shown is a relative Bradley-Terry score, not a percentage — compare it only to other models on this board.
1197.1
1197.1
median 1415.2open leader 1665.0
Overall best: Claude Opus 5.5 (Max) 1809.8
2nd percentile · #54 of 55 open · #141 of 146 all
#54 of 55
#141 of 146
Arena
Arena · Oct 2026

Scores aggregated from public benchmark sources (Arena: 1 board, SWE-bench: 1 board) — each linked from the benchmark pages. llmrun does not run these benchmarks. Percentiles and ranks are among open models in the llmrun catalogue; the median and leader marks refer to the same field.