Starcoder2 7B — Benchmarks
Benchmark scores for Starcoder2 7B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MMLU | 38.8% | #67 / 76 | #121 / 136 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| GSM8K | 32.7% | #42 / 59 | #62 / 93 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.