Llama 3.1 405B Instruct — Benchmarks

Benchmark scores for Llama 3.1 405B Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Overall rank: #36 of 73 open modelscomposite 44.5/100 across 6 benchmarks in 3 categories · methodology

Knowledge

BenchmarkScoreOpen rankAll models
MMLU-Pro73.3%#32 / 119#91 / 259
MMLU84.5%#6 / 76#13 / 136

Math

BenchmarkScoreOpen rankAll models
AIME 2024/20259.7%#20 / 34#116 / 155
MATH Level 549.8%#14 / 32#64 / 108

Reasoning

BenchmarkScoreOpen rankAll models
SimpleBench23.0%#16 / 19#79 / 90
GPQA Diamond50.9%#20 / 46#118 / 182

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.