Mistral Large Instruct 2407 vs Qwen2.5 72B Instruct
Mistral Large Instruct 2407 and Qwen2.5 72B Instruct match in llmrun Score, with values of 81.1 versus 81.7; neither fits 24 GB.
Model A · Mistral AI
Mistral Large Instruct 2407122.6B · Other · Jul 2024
Model B · Alibaba
Qwen2.5 72B Instruct72.7B · 32K context · Other · Sep 2024
Choose Qwen2.5 72B Instruct if you want…
Ahead on the benchmarks
4 of 6 shared boards
Fits a 48 GB GPU
Q4_K_M · 49.3 GB; Mistral Large Instruct 2407 needs 42.6 GB at its smallest quant
Fits a Mac 64 GB
Q4_K_M · 49.3 GB; Mistral Large Instruct 2407 needs 42.6 GB at its smallest quant
Lighter on memory
44.6 vs 80.9 GB at Q4_K_M
Mistral Large Instruct 2407: no clear edge over Qwen2.5 72B Instruct in the data we have.
On your hardware
Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.
8 GB
RTX 4060 · 8 GB tier
Mistral Large Instruct 2407
Doesn't fit
smallest quant needs 42.6 GB
Qwen2.5 72B Instruct
Doesn't fit
smallest quant needs 25.7 GB
12 GB
RTX 3060 12GB · 12 GB tier
Mistral Large Instruct 2407
Doesn't fit
smallest quant needs 42.6 GB
Qwen2.5 72B Instruct
Doesn't fit
smallest quant needs 25.7 GB
16 GB
RTX 5060 Ti 16GB · 16 GB tier
Mistral Large Instruct 2407
Doesn't fit
smallest quant needs 42.6 GB
Qwen2.5 72B Instruct
Doesn't fit
smallest quant needs 25.7 GB
24 GBreference
RTX 4090 · 24 GB tier
Mistral Large Instruct 2407
Doesn't fit
smallest quant needs 42.6 GB
Qwen2.5 72B Instruct
Doesn't fit
smallest quant needs 25.7 GB
32 GB
RTX 5090 · 32 GB tier
Mistral Large Instruct 2407
Doesn't fit
smallest quant needs 42.6 GB
Qwen2.5 72B Instruct
IQ2_M · ~46 tok/s
30.2 GB · up to 16Kfits
48 GB
RTX A6000 · 48 GB tier
Mistral Large Instruct 2407
IQ2_S · ~12 tok/s
47.7 GB · up to 16Kmore headroom
Qwen2.5 72B Instruct
Q4_K_M · ~11 tok/stight
49.3 GB · up to 8K
Mac 32 GB
Mac Mini M4 · Macs
Mistral Large Instruct 2407
Doesn't fit
smallest quant needs 42.6 GB
Qwen2.5 72B Instruct
IQ2_S · ~4 tok/s
28.4 GB · up to 16Kfits
Mac 64 GB
Mac Studio M4 Max · Macs
Mistral Large Instruct 2407
Q2_K_S · ~7 tok/s
59.5 GB · up to 16K
Qwen2.5 72B Instruct
Q4_K_M · ~9 tok/s
49.3 GB · up to 32Kmore headroom
Mac 128 GB
Mac Studio M4 Max · Macs
Mistral Large Instruct 2407
Q4_K_M · ~5 tok/s
86.4 GB · up to 32K
Qwen2.5 72B Instruct
Q4_K_M · ~9 tok/s
49.3 GB · up to 32Kfaster
Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).
Overall
Mistral Large Instruct 2407
Qwen2.5 72B Instruct
Reasoning
Mistral Large Instruct 2407
Qwen2.5 72B Instruct
Mistral Large Instruct 2407 · #81 of 100 open models · #42 of 60 that fit ≤96 GB
Qwen2.5 72B Instruct · #80 of 100 open models · #30 of 49 that fit ≤64 GB
Benchmarks
6 shared boards: Mistral Large Instruct 2407 leads 1, Qwen2.5 72B Instruct leads 4 · Benchmarks imported Oct 2026
Mistral Large Instruct 2407
49.0%#56/98 open
IndependentEpoch AI · Jul 2024
Qwen2.5 72B Instruct
49.1%#54/98 open
IndependentEpoch AI · Sep 2024
Mistral Large Instruct 2407
8.5%#59/86 open
IndependentEpoch AI · Jul 2024
Qwen2.5 72B Instruct
8.1%#60/86 open
IndependentEpoch AI · Sep 2024
Mistral Large Instruct 2407
65.9%#45/145 open
IndependentTIGER-Lab
Qwen2.5 72B Instruct
71.6%#35/145 open
IndependentTIGER-Lab
Mistral Large Instruct 2407
44.8%#17/39 open
IndependentEpoch AI · Jul 2024
Qwen2.5 72B Instruct
63.2%#11/39 open
IndependentEpoch AI · Sep 2024
Mistral Large Instruct 2407
61.2%#45/68 open
Lab-reportedEpoch AI · Jul 2024
Qwen2.5 72B Instruct
62.9%#40/68 open
Lab-reportedEpoch AI · Sep 2024
Mistral Large Instruct 2407
57.1#20/26 open
Lab-reportedEpoch AI · Jul 2024
Qwen2.5 72B Instruct
57.5#18/26 open
Lab-reportedEpoch AI · Sep 2024
7 more boards (other shared and single-model boards)
Mistral Large Instruct 2407
1314.4#98/187 open
ArenaLMArena · Oct 2026
Qwen2.5 72B Instruct
1302.9#106/187 open
ArenaLMArena · Oct 2026
Mistral Large Instruct 2407
80.0%#11/85 open
Lab-reportedEpoch AI · Jul 2024
Qwen2.5 72B Instruct
85.3%#3/85 open
Lab-reportedEpoch AI · Sep 2024
Only Mistral Large Instruct 2407 (1)
- SimpleBench22.5%
Only Qwen2.5 72B Instruct (4)
- WeirdML16.0%
- BALROG16.2%
- LMCA13.4%
- METR Time Horizons35.8%
VRAM by quantization
Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.
Q2_K
Mistral Large Instruct 2407
57.3 GB45.2 GB file
32K 69.1 GB · 128K 107 GB
Qwen2.5 72B Instruct
31.9 GB29.8 GB file
32K 41.9 GB · 128K —
Q3_K_S
Mistral Large Instruct 2407
59.0 GB52.8 GB file
32K 70.8 GB · 128K 109 GB
Qwen2.5 72B Instruct
32.8 GB34.5 GB file
32K 42.9 GB · 128K —
Q3_K_M
Mistral Large Instruct 2407
65.8 GB59.1 GB file
32K 77.6 GB · 128K 115 GB
Qwen2.5 72B Instruct
36.4 GB37.7 GB file
32K 46.5 GB · 128K —
Q4_0
Mistral Large Instruct 2407
67.4 GB69.1 GB file
32K 79.3 GB · 128K 117 GB
Qwen2.5 72B Instruct
37.3 GB41.4 GB file
32K 47.4 GB · 128K —
Q4_K_M
Mistral Large Instruct 2407
80.9 GB73.2 GB file
32K 92.7 GB · 128K 131 GB
Qwen2.5 72B Instruct
44.6 GB47.4 GB file
32K 54.7 GB · 128K —
Q5_K_M
Mistral Large Instruct 2407
96.1 GB86.5 GB file
32K 108 GB · 128K 146 GB
Qwen2.5 72B Instruct
52.8 GB54.4 GB file
32K 62.8 GB · 128K —
Q6_K
Mistral Large Instruct 2407
111 GB100.6 GB file
32K 123 GB · 128K 161 GB
Qwen2.5 72B Instruct
61.0 GB64.3 GB file
32K 71.0 GB · 128K —
Q8_0
Mistral Large Instruct 2407
135 GB130.3 GB file
32K 147 GB · 128K 184 GB
Qwen2.5 72B Instruct
73.7 GB77.3 GB file
32K 83.8 GB · 128K —
17 more quants
IQ2_XXS
Mistral Large Instruct 2407
37.1 GB32.4 GB file
32K 48.9 GB · 128K 86.7 GB
Qwen2.5 72B Instruct
21.0 GB25.5 GB file
32K 31.0 GB · 128K —
IQ2_XS
Mistral Large Instruct 2407
40.5 GB36.1 GB file
32K 52.3 GB · 128K 90.1 GB
Qwen2.5 72B Instruct
22.8 GB27.1 GB file
32K 32.9 GB · 128K —
IQ2_S
Mistral Large Instruct 2407
42.2 GB38.4 GB file
32K 54.0 GB · 128K 91.8 GB
Qwen2.5 72B Instruct
23.7 GB27.9 GB file
32K 33.8 GB · 128K —
IQ2_M
Mistral Large Instruct 2407
45.5 GB41.6 GB file
32K 57.3 GB · 128K 95.1 GB
Qwen2.5 72B Instruct
25.5 GB29.3 GB file
32K 35.6 GB · 128K —
IQ3_XXS
Mistral Large Instruct 2407
52.3 GB47.0 GB file
32K 64.1 GB · 128K 102 GB
Qwen2.5 72B Instruct
29.1 GB31.8 GB file
32K 39.2 GB · 128K —
Q2_K_S
Mistral Large Instruct 2407
54.0 GB41.6 GB file
32K 65.8 GB · 128K 104 GB
Qwen2.5 72B Instruct
30.1 GB29.6 GB file
32K 40.1 GB · 128K —
IQ3_XS
Mistral Large Instruct 2407
55.6 GB50.1 GB file
32K 67.4 GB · 128K 105 GB
Qwen2.5 72B Instruct
31.0 GB32.8 GB file
32K 41.0 GB · 128K —
IQ3_S
Mistral Large Instruct 2407
not listed
Qwen2.5 72B Instruct
31.9 GB34.5 GB file
32K 41.9 GB · 128K —
IQ3_M
Mistral Large Instruct 2407
60.7 GB55.3 GB file
32K 72.5 GB · 128K 110 GB
Qwen2.5 72B Instruct
33.7 GB35.5 GB file
32K 43.8 GB · 128K —
Q3_K_L
Mistral Large Instruct 2407
69.1 GB64.6 GB file
32K 80.9 GB · 128K 119 GB
Qwen2.5 72B Instruct
38.2 GB39.5 GB file
32K 48.3 GB · 128K —
IQ4_XS
Mistral Large Instruct 2407
72.5 GB65.4 GB file
32K 84.3 GB · 128K 122 GB
Qwen2.5 72B Instruct
40.1 GB39.7 GB file
32K 50.1 GB · 128K —
IQ4_NL
Mistral Large Instruct 2407
not listed
Qwen2.5 72B Instruct
41.9 GB41.3 GB file
32K 51.9 GB · 128K —
Q4_1
Mistral Large Instruct 2407
not listed
Qwen2.5 72B Instruct
41.9 GB45.7 GB file
32K 51.9 GB · 128K —
Q4_K_S
Mistral Large Instruct 2407
75.9 GB69.6 GB file
32K 87.7 GB · 128K 125 GB
Qwen2.5 72B Instruct
41.9 GB43.9 GB file
32K 51.9 GB · 128K —
Q5_0
Mistral Large Instruct 2407
84.3 GB84.4 GB file
32K 96.1 GB · 128K 134 GB
Qwen2.5 72B Instruct
46.4 GB50.3 GB file
32K 56.5 GB · 128K —
Q5_K_S
Mistral Large Instruct 2407
92.7 GB84.4 GB file
32K 105 GB · 128K 142 GB
Qwen2.5 72B Instruct
51.0 GB51.4 GB file
32K 61.0 GB · 128K —
BF16
Mistral Large Instruct 2407
270 GB~245.2 GB file
32K 282 GB · 128K 319 GB
Qwen2.5 72B Instruct
146 GB~145.4 GB file
32K 156 GB · 128K —
Mistral Large Instruct 2407
Ollama · Q4_K_M
ollama run hf.co/MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF:Q4_K_MQwen2.5 72B Instruct
Ollama · Q4_K_M
ollama run hf.co/bartowski/Qwen2.5-72B-Instruct-GGUF:Q4_K_M| Spec | Mistral Large Instruct 2407 | Qwen2.5 72B Instruct |
|---|---|---|
| Publisher | Mistral AI | Alibaba |
| Parameters | 122.6B | 72.7B |
| Architecture | — | Qwen2ForCausalLM |
| Context | — | 32K tokens |
| Modalities | Chat, Function-calling | Chat, Function-calling |
| License | Other | Other |
| Released | Jul 2024 | Sep 2024 |
Frequently Asked Questions
Which is better, Mistral Large Instruct 2407 or Qwen2.5 72B Instruct?
Mistral Large Instruct 2407 and Qwen2.5 72B Instruct match in llmrun Score, with values of 81.1 versus 81.7; neither fits 24 GB. Choose Qwen2.5 72B Instruct for ahead on the benchmarks and fits a 48 GB GPU.
Which needs less VRAM, Mistral Large Instruct 2407 or Qwen2.5 72B Instruct?
At Q4_K_M, Mistral Large Instruct 2407 requires 80.9 GB while Qwen2.5 72B Instruct needs 44.6 GB, making Qwen2.5 72B Instruct the easier model to run on your local setup.
Can I run Mistral Large Instruct 2407 or Qwen2.5 72B Instruct on a 16 GB GPU?
Mistral Large Instruct 2407 does not fit (smallest quant needs 42.6 GB); Qwen2.5 72B Instruct does not fit (smallest quant needs 25.7 GB).