Qwen 1 8B — Benchmarks

Benchmark scores for Qwen 1 8B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreRank
MMLU28.2%#71 / 74

Math

BenchmarkScoreRank
GSM8K21.2%#50 / 58

Reasoning

BenchmarkScoreRank
BIG-Bench Hard28.2%#36 / 36

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.