Hermes 2 Theta Llama 3 70B — Benchmarks

Benchmark scores for Hermes 2 Theta Llama 3 70B aggregated from public leaderboards, with how it ranks among open models. See hardware requirements for what you need to run it.

Math

BenchmarkScoreOpen rankAll models
AIME 2024/20252.5%#30 / 34#145 / 155
MATH Level 522.7%#24 / 32#87 / 108

Reasoning

BenchmarkScoreOpen rankAll models
GPQA Diamond37.5%#33 / 46#152 / 182

Scores aggregated from public benchmark sources (each linked from the benchmark pages). llmrun does not run these benchmarks.