Starcoder2 15B — Benchmarks
Benchmark scores for Starcoder2 15B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Rank |
|---|---|---|
| MMLU | 64.1% | #17 / 36 |
Math
| Benchmark | Score | Rank |
|---|---|---|
| GSM8K | 57.7% | #15 / 27 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.