Mistral 7B v0.1 — Benchmarks

Benchmark scores for Mistral 7B v0.1 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreRank
MMLU56.6%#23 / 36
HellaSwag81.0%#5 / 22

Math

BenchmarkScoreRank
GSM8K50.0%#17 / 27

Reasoning

BenchmarkScoreRank
BIG-Bench Hard39.5%#7 / 11

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.