Starcoder2 3B — Benchmarks
Benchmark scores for Starcoder2 3B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MMLU | 36.6% | #69 / 76 | #123 / 136 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| GSM8K | 21.6% | #50 / 59 | #71 / 93 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.