Mixtral 8x7B Instruct v0.1 — Benchmarks

Benchmark scores for Mixtral 8x7B Instruct v0.1 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Math

BenchmarkScoreRank
MATH Level 59.3%#19 / 23

Reasoning

BenchmarkScoreRank
GPQA Diamond30.6%#22 / 28

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.