Falcon 40B — Benchmarks

Benchmark scores for Falcon 40B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreRank
MMLU56.9%#47 / 74
HellaSwag85.3%#7 / 41

Math

BenchmarkScoreRank
GSM8K25.0%#46 / 58

Reasoning

BenchmarkScoreRank
BIG-Bench Hard37.1%#28 / 36

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.