Starcoder2 7B — Benchmarks
Benchmark scores for Starcoder2 7B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Overall rank: #108 of 123 open modelscomposite 25.1/100 across 4 benchmarks in 3 categories · methodology
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| ARC Challenge | 38.7% | #40 / 51 | #63 / 77 |
| MMLU | 38.8% | #67 / 77 | #121 / 136 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| GSM8K | 32.7% | #42 / 60 | #62 / 93 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| WinoGrande | 57.1% | #42 / 46 | #76 / 80 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.