Yi 34B Chat — Benchmarks
Benchmark scores for Yi 34B Chat aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.
No overall rank for Yi 34B Chat: an overall score is only published when a model has been measured on enough of the benchmarks current models are still submitted to. Its individual scores below stand on their own — see the methodology for how the overall score is built.
Instruction Following
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| LMArena Text | 1183.5 | #146 / 182 | #331 / 391 |
Knowledge
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MMLU | 73.5% | #23 / 85 | #49 / 136 |
Math
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| MATH Level 5 | 5.1% | #37 / 39 | #104 / 107 |
| GSM8K | 76.0% | #15 / 62 | #23 / 93 |
Reasoning
| Benchmark | Score | Open rank | All models |
|---|---|---|---|
| GPQA Diamond | 14.7% | #93 / 94 | #286 / 289 |
| BIG-Bench Hard | 71.7% | #7 / 38 | #10 / 50 |
Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.