Phi 3 Small 8k Instruct — Benchmarks

Benchmark scores for Phi 3 Small 8k Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreOpen rankAll models
HellaSwag77.0%#19 / 42#38 / 76
MMLU75.7%#18 / 76#43 / 136

Reasoning

BenchmarkScoreOpen rankAll models
BIG-Bench Hard79.1%#4 / 37#7 / 50

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.