Phi 3 Mini 4k Instruct — Benchmarks

Benchmark scores for Phi 3 Mini 4k Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreOpen rankAll models
HellaSwag76.7%#21 / 42#40 / 76
MMLU-Pro45.7%#68 / 119#178 / 259
MMLU68.8%#28 / 76#67 / 136

Reasoning

BenchmarkScoreOpen rankAll models
BIG-Bench Hard71.7%#7 / 37#11 / 50

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.