Starcoder2 7B — Benchmarks
Benchmark scores for Starcoder2 7B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Rank |
|---|---|---|
| MMLU | 38.8% | #30 / 36 |
Math
| Benchmark | Score | Rank |
|---|---|---|
| GSM8K | 32.7% | #21 / 27 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.