Phi 3 Mini 4k Instruct — Benchmarks
Benchmark scores for Phi 3 Mini 4k Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| HellaSwag | 76.7% | #21 / 42 | #40 / 76 |
| MMLU-Pro | 45.7% | #68 / 119 | #178 / 259 |
| ARC Challenge | 84.9% | #8 / 51 | #14 / 77 |
| OpenBookQA | 88.0% | #1 / 21 | #1 / 42 |
| TriviaQA | 64.0% | #15 / 18 | #34 / 39 |
| MMLU | 68.8% | #28 / 77 | #67 / 136 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| BIG-Bench Hard | 71.7% | #7 / 37 | #11 / 50 |
| WinoGrande | 70.8% | #24 / 46 | #48 / 80 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.