Starcoder2 3B — Benchmarks
Benchmark scores for Starcoder2 3B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
Knowledge
| Benchmark | Score | Rank |
|---|---|---|
| MMLU | 36.6% | #67 / 74 |
Math
| Benchmark | Score | Rank |
|---|---|---|
| GSM8K | 21.6% | #49 / 58 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.