Starcoder2 15B — Benchmarks
Benchmark scores for Starcoder2 15B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MMLU | 64.1% | #36 / 76 | #80 / 136 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| GSM8K | 57.7% | #26 / 59 | #36 / 93 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.