Mistral Nemo Instruct 2407 vs Qwen2.5 7B Instruct
Mistral Nemo Instruct 2407 and Qwen2.5 7B Instruct match in llmrun Score, with values of 65.4 versus 65.1; both fit 24 GB at Q4_K_M; Qwen2.5 7B Instruct is 1.6× faster on RTX 4090 (~131 vs ~81 tok/s).
Model A · Mistral AI
Mistral Nemo Instruct 240712.2B · 128K context · Apache 2.0 · Jul 2024
Model B · Alibaba
Qwen2.5 7B Instruct7.6B · 32K context · Apache 2.0 · Sep 2024
Choose Mistral Nemo Instruct 2407 if you want…
Longer context window
128K vs 32K tokens
Choose Qwen2.5 7B Instruct if you want…
Fits an 8 GB GPU
Q4_K_M · 5.8 GB; Mistral Nemo Instruct 2407 needs 7 GB at its smallest quant
1.6× faster on RTX 4090
~131 vs ~81 tok/s
Lighter on memory
5.0 vs 8.1 GB at Q4_K_M
On your hardware
Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.
8 GB
RTX 4060 · 8 GB tier
Mistral Nemo Instruct 2407
IQ2_M · ~37 tok/s
7.8 GB · up to 16K
Qwen2.5 7B Instruct
Q4_K_M · ~35 tok/s
5.8 GB · up to 32Kmore headroom
12 GB
RTX 3060 12GB · 12 GB tier
Mistral Nemo Instruct 2407
Q4_K_M · ~29 tok/s
11 GB · up to 16K
Qwen2.5 7B Instruct
Q4_K_M · ~47 tok/s
5.8 GB · up to 32Kfaster
16 GB
RTX 5060 Ti 16GB · 16 GB tier
Mistral Nemo Instruct 2407
Q4_K_M · ~36 tok/s
11 GB · up to 32K
Qwen2.5 7B Instruct
Q4_K_M · ~58 tok/s
5.8 GB · up to 32Kfaster
24 GBreference
RTX 4090 · 24 GB tier
Mistral Nemo Instruct 2407
Q4_K_M · ~81 tok/s
11 GB · up to 64K
Qwen2.5 7B Instruct
Q4_K_M · ~131 tok/s
5.8 GB · up to 32Kfaster
32 GB
RTX 5090 · 32 GB tier
Mistral Nemo Instruct 2407
Q4_K_M · ~144 tok/s
11 GB · up to 64K
Qwen2.5 7B Instruct
Q4_K_M · ~233 tok/s
5.8 GB · up to 32Kfaster
48 GB
RTX A6000 · 48 GB tier
Mistral Nemo Instruct 2407
Q4_K_M · ~62 tok/s
11 GB · up to 128K
Qwen2.5 7B Instruct
Q4_K_M · ~100 tok/s
5.8 GB · up to 32Kfaster
Mac 32 GB
Mac Mini M4 · Macs
Mistral Nemo Instruct 2407
Q4_K_M · ~10 tok/s
11 GB · up to 64K
Qwen2.5 7B Instruct
Q4_K_M · ~17 tok/s
5.8 GB · up to 32Kfaster
Mac 64 GB
Mac Studio M4 Max · Macs
Mistral Nemo Instruct 2407
Q4_K_M · ~47 tok/s
11 GB · up to 128K
Qwen2.5 7B Instruct
Q4_K_M · ~77 tok/s
5.8 GB · up to 32Kfaster
Mac 128 GB
Mac Studio M4 Max · Macs
Mistral Nemo Instruct 2407
Q4_K_M · ~47 tok/s
11 GB · up to 128K
Qwen2.5 7B Instruct
Q4_K_M · ~77 tok/s
5.8 GB · up to 32Kfaster
Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).
Overall
Mistral Nemo Instruct 2407
Qwen2.5 7B Instruct
Reasoning
Mistral Nemo Instruct 2407
no data
Qwen2.5 7B Instruct
Mistral Nemo Instruct 2407 · #84 of 92 open models · #27 of 34 that fit 24 GB
Qwen2.5 7B Instruct · #86 of 92 open models · #29 of 34 that fit 24 GB
Benchmarks
2 shared boards: Mistral Nemo Instruct 2407 leads 1, Qwen2.5 7B Instruct leads 1 · Benchmarks imported Oct 2026
Mistral Nemo Instruct 2407
29.9%#81/97 open
IndependentEpoch AI · Jul 2024
Qwen2.5 7B Instruct
35.5%#74/97 open
IndependentEpoch AI · Sep 2024
Mistral Nemo Instruct 2407
48.6%#63/68 open
Lab-reportedEpoch AI · Jul 2024
Qwen2.5 7B Instruct
47.7%#64/68 open
Lab-reportedEpoch AI · Sep 2024
7 more boards (other shared and single-model boards)
Mistral Nemo Instruct 2407
17.6%#6/15 open
IndependentEpoch AI · Jul 2024
Qwen2.5 7B Instruct
7.8%#13/15 open
IndependentEpoch AI · Sep 2024
Only Mistral Nemo Instruct 2407 (2)
- MMLU-Pro44.8%
- MATH Level 510.8%
Only Qwen2.5 7B Instruct (4)
- AIME 2024/20252.5%
- MMLU72.9%
- Chess Puzzles0.0%
- LMCA6.4%
VRAM by quantization
Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.
Q2_K
Mistral Nemo Instruct 2407
5.9 GB4.8 GB file
32K 12.2 GB · 128K 32.3 GB
Qwen2.5 7B Instruct
3.7 GB3.0 GB file
32K 5.4 GB · 128K —
Q3_K_S
Mistral Nemo Instruct 2407
6.1 GB5.5 GB file
32K 12.4 GB · 128K 32.5 GB
Qwen2.5 7B Instruct
3.8 GB3.5 GB file
32K 5.5 GB · 128K —
Q3_K_M
Mistral Nemo Instruct 2407
6.7 GB6.1 GB file
32K 13.0 GB · 128K 33.1 GB
Qwen2.5 7B Instruct
4.1 GB3.8 GB file
32K 5.9 GB · 128K —
Q4_0
Mistral Nemo Instruct 2407
6.8 GB7.1 GB file
32K 13.1 GB · 128K 33.3 GB
Qwen2.5 7B Instruct
4.2 GB4.4 GB file
32K 6.0 GB · 128K —
Q4_K_M
Mistral Nemo Instruct 2407
8.1 GB7.5 GB file
32K 14.4 GB · 128K 34.5 GB
Qwen2.5 7B Instruct
5.0 GB4.7 GB file
32K 6.8 GB · 128K —
Q5_K_M
Mistral Nemo Instruct 2407
9.5 GB8.7 GB file
32K 15.7 GB · 128K 35.9 GB
Qwen2.5 7B Instruct
5.8 GB5.4 GB file
32K 7.6 GB · 128K —
Q6_K
Mistral Nemo Instruct 2407
10.8 GB10.1 GB file
32K 17.1 GB · 128K 37.2 GB
Qwen2.5 7B Instruct
6.7 GB6.3 GB file
32K 8.5 GB · 128K —
Q8_0
Mistral Nemo Instruct 2407
13.0 GB13.0 GB file
32K 19.3 GB · 128K 39.4 GB
Qwen2.5 7B Instruct
8.0 GB8.1 GB file
32K 9.8 GB · 128K —
20 more quants
IQ2_XXS
Mistral Nemo Instruct 2407
4.1 GB3.6 GB file
32K 10.4 GB · 128K 30.5 GB
Qwen2.5 7B Instruct
2.5 GB2.3 GB file
32K 4.3 GB · 128K —
IQ2_XS
Mistral Nemo Instruct 2407
4.4 GB3.9 GB file
32K 10.7 GB · 128K 30.8 GB
Qwen2.5 7B Instruct
2.7 GB2.5 GB file
32K 4.5 GB · 128K —
IQ2_S
Mistral Nemo Instruct 2407
4.6 GB4.1 GB file
32K 10.8 GB · 128K 31.0 GB
Qwen2.5 7B Instruct
2.8 GB2.6 GB file
32K 4.6 GB · 128K —
IQ2_M
Mistral Nemo Instruct 2407
4.9 GB4.4 GB file
32K 11.1 GB · 128K 31.3 GB
Qwen2.5 7B Instruct
3.0 GB2.8 GB file
32K 4.8 GB · 128K —
IQ3_XXS
Mistral Nemo Instruct 2407
5.5 GB4.9 GB file
32K 11.8 GB · 128K 31.9 GB
Qwen2.5 7B Instruct
3.4 GB3.1 GB file
32K 5.1 GB · 128K —
Q2_K_S
Mistral Nemo Instruct 2407
not listed
Qwen2.5 7B Instruct
3.5 GB2.8 GB file
32K 5.2 GB · 128K —
IQ3_XS
Mistral Nemo Instruct 2407
5.8 GB5.3 GB file
32K 12.1 GB · 128K 32.2 GB
Qwen2.5 7B Instruct
3.6 GB3.3 GB file
32K 5.3 GB · 128K —
IQ3_S
Mistral Nemo Instruct 2407
5.9 GB5.6 GB file
32K 12.2 GB · 128K 32.3 GB
Qwen2.5 7B Instruct
3.7 GB3.5 GB file
32K 5.4 GB · 128K —
IQ3_M
Mistral Nemo Instruct 2407
6.2 GB5.7 GB file
32K 12.5 GB · 128K 32.7 GB
Qwen2.5 7B Instruct
3.8 GB3.6 GB file
32K 5.6 GB · 128K —
Q3_K_L
Mistral Nemo Instruct 2407
7.0 GB6.6 GB file
32K 13.3 GB · 128K 33.4 GB
Qwen2.5 7B Instruct
4.3 GB4.1 GB file
32K 6.1 GB · 128K —
IQ4_XS
Mistral Nemo Instruct 2407
7.3 GB6.7 GB file
32K 13.6 GB · 128K 33.7 GB
Qwen2.5 7B Instruct
4.5 GB4.2 GB file
32K 6.3 GB · 128K —
IQ4_NL
Mistral Nemo Instruct 2407
not listed
Qwen2.5 7B Instruct
4.7 GB4.4 GB file
32K 6.5 GB · 128K —
Q4_1
Mistral Nemo Instruct 2407
not listed
Qwen2.5 7B Instruct
4.7 GB4.9 GB file
32K 6.5 GB · 128K —
Q4_K_S
Mistral Nemo Instruct 2407
7.6 GB7.1 GB file
32K 13.9 GB · 128K 34.0 GB
Qwen2.5 7B Instruct
4.7 GB4.5 GB file
32K 6.5 GB · 128K —
Q4_K_L
Mistral Nemo Instruct 2407
8.2 GB8.0 GB file
32K 14.5 GB · 128K 34.6 GB
Qwen2.5 7B Instruct
5.1 GB5.1 GB file
32K 6.8 GB · 128K —
Q5_0
Mistral Nemo Instruct 2407
8.4 GB8.5 GB file
32K 14.7 GB · 128K 34.8 GB
Qwen2.5 7B Instruct
5.2 GB5.3 GB file
32K 6.9 GB · 128K —
Q5_1
Mistral Nemo Instruct 2407
not listed
Qwen2.5 7B Instruct
5.7 GB5.8 GB file
32K 7.4 GB · 128K —
Q5_K_S
Mistral Nemo Instruct 2407
9.1 GB8.5 GB file
32K 15.4 GB · 128K 35.6 GB
Qwen2.5 7B Instruct
5.7 GB5.3 GB file
32K 7.4 GB · 128K —
Q5_K_L
Mistral Nemo Instruct 2407
9.6 GB9.1 GB file
32K 15.9 GB · 128K 36.0 GB
Qwen2.5 7B Instruct
5.9 GB5.8 GB file
32K 7.7 GB · 128K —
BF16
Mistral Nemo Instruct 2407
25.2 GB~24.5 GB file
32K 31.5 GB · 128K 51.6 GB
Qwen2.5 7B Instruct
15.7 GB~15.2 GB file
32K 17.4 GB · 128K —
Mistral Nemo Instruct 2407
Ollama · Q4_K_M
ollama run hf.co/MaziyarPanahi/Mistral-Nemo-Instruct-2407-GGUF:Q4_K_MQwen2.5 7B Instruct
Ollama · Q4_K_M
ollama run hf.co/bartowski/Qwen2.5-7B-Instruct-GGUF:Q4_K_M| Spec | Mistral Nemo Instruct 2407 | Qwen2.5 7B Instruct |
|---|---|---|
| Publisher | Mistral AI | Alibaba |
| Parameters | 12.2B | 7.6B |
| Architecture | MistralForCausalLM | Qwen2ForCausalLM |
| Context | 128K tokens | 32K tokens |
| Modalities | Chat, Function-calling | Chat, Function-calling |
| License | Apache 2.0 | Apache 2.0 |
| Released | Jul 2024 | Sep 2024 |
Frequently Asked Questions
Which is better, Mistral Nemo Instruct 2407 or Qwen2.5 7B Instruct?
Mistral Nemo Instruct 2407 and Qwen2.5 7B Instruct match in llmrun Score, with values of 65.4 versus 65.1; both fit 24 GB at Q4_K_M; Qwen2.5 7B Instruct is 1.6× faster on RTX 4090 (~131 vs ~81 tok/s). Choose Mistral Nemo Instruct 2407 for longer context window; choose Qwen2.5 7B Instruct for fits an 8 GB GPU and 1.6× faster on RTX 4090.
Which needs less VRAM, Mistral Nemo Instruct 2407 or Qwen2.5 7B Instruct?
At Q4_K_M, Mistral Nemo Instruct 2407 requires 8.1 GB while Qwen2.5 7B Instruct needs 5.0 GB, making Qwen2.5 7B Instruct the easier model to run on your local setup.
Which is faster on RTX 4090?
Estimated decode speed on RTX 4090 is about 81 tok/s for Mistral Nemo Instruct 2407 (Q4_K_M) and 131 tok/s for Qwen2.5 7B Instruct (Q4_K_M), so Qwen2.5 7B Instruct is faster. Estimates, ±20%.
Can I run Mistral Nemo Instruct 2407 or Qwen2.5 7B Instruct on a 16 GB GPU?
Mistral Nemo Instruct 2407 fits at Q4_K_M; Qwen2.5 7B Instruct fits at Q4_K_M.
Which has a longer context window, Mistral Nemo Instruct 2407 or Qwen2.5 7B Instruct?
Mistral Nemo Instruct 2407 supports 131,072 tokens and Qwen2.5 7B Instruct supports 32,768 tokens.