Starcoder2 7B — Benchmarks

Benchmark scores for Starcoder2 7B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreOpen rankAll models
MMLU38.8%#67 / 76#121 / 136

Math

BenchmarkScoreOpen rankAll models
GSM8K32.7%#42 / 59#62 / 93

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.

Starcoder2 7B Benchmarks — Scores & Rankings | llmrun