Starcoder2 3B — Benchmarks

Benchmark scores for Starcoder2 3B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreRank
MMLU36.6%#67 / 74

Math

BenchmarkScoreRank
GSM8K21.6%#49 / 58

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.