Phi 3 Mini 4k Instruct — Benchmarks

Benchmark scores for Phi 3 Mini 4k Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Coding

BenchmarkScoreRank
LiveBench Coding15.5#13 / 13

Knowledge

BenchmarkScoreRank
MMLU68.8%#14 / 36
HellaSwag76.7%#8 / 22

Math

BenchmarkScoreRank
LiveBench Math15.0#13 / 13

Reasoning

BenchmarkScoreRank
BIG-Bench Hard71.7%#2 / 11
LiveBench Reasoning26.8#12 / 13

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.