C4ai Command R 08 2024 — Benchmarks

Benchmark scores for C4ai Command R 08 2024 aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

No overall rank for C4ai Command R 08 2024: an overall score is only published when a model has been measured on enough of the benchmarks current models are still submitted to. Its individual scores below stand on their own — see the methodology for how the overall score is built.

Instruction Following

BenchmarkScoreOpen rankAll models
LMArena Text1250.1#125 / 182#298 / 391

Knowledge

BenchmarkScoreOpen rankAll models
MMLU65.2%#38 / 85#78 / 136

Reasoning

BenchmarkScoreOpen rankAll models
DTBench46.4%#64 / 67#203 / 210
LMCA9.2%#47 / 53#161 / 172

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.

C4ai Command R 08 2024 Benchmarks — Scores & Rankings | llmrun