INTELLECT 1 Instruct — Benchmarks

Benchmark scores for INTELLECT 1 Instruct aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Knowledge

BenchmarkScoreRank
MMLU49.9%#57 / 74
HellaSwag71.4%#26 / 41

Math

BenchmarkScoreRank
GSM8K38.6%#34 / 58

Reasoning

BenchmarkScoreRank
BIG-Bench Hard34.8%#31 / 36

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.