Mistral 7B Instruct v0.3 — Benchmarks
Benchmark scores for Mistral 7B Instruct v0.3 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Rank |
|---|---|---|
| MMLU | 59.9% | #22 / 36 |
Math
| Benchmark | Score | Rank |
|---|---|---|
| MATH Level 5 | 3.6% | #22 / 23 |
Reasoning
| Benchmark | Score | Rank |
|---|---|---|
| GPQA Diamond | 15.2% | #28 / 28 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.