Mistral Nemo Instruct 2407 — Benchmarks
Benchmark scores for Mistral Nemo Instruct 2407 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Overall rank: #72 of 78 open modelscomposite 20/100 across 4 benchmarks in 3 categories · methodology
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MMLU-Pro | 44.8% | #86 / 144 | #180 / 257 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MATH Level 5 | 10.8% | #33 / 39 | #100 / 107 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| DTBench | 48.6% | #62 / 67 | #199 / 210 |
| GPQA Diamond | 29.9% | #80 / 94 | #268 / 289 |
| BALROG | 17.6% | #6 / 14 | #29 / 40 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.