Llama 3.1 8B Instruct — Benchmarks

Benchmark scores for Llama 3.1 8B Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Overall rank: #98 of 123 open modelscomposite 31.2/100 across 10 benchmarks in 4 categories · methodology

Coding

BenchmarkScoreOpen rankAll models
SciCode13.2%#49 / 50#154 / 155

Knowledge

BenchmarkScoreOpen rankAll models
MMLU-Pro44.3%#72 / 119#183 / 259
BoolQ82.8%#12 / 33#33 / 77
MMLU56.1%#51 / 77#100 / 136

Math

BenchmarkScoreOpen rankAll models
AIME 2024/20251.7%#67 / 74#258 / 270
MATH Level 522.9%#23 / 32#86 / 108
GSM8K82.4%#12 / 60#19 / 93

Reasoning

BenchmarkScoreOpen rankAll models
GPQA Diamond27.0%#74 / 83#278 / 291
CritPt0.0%#41 / 50#149 / 167
PIQA81.2%#15 / 35#30 / 60

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.