Mistral Large Instruct 2411 vs Mistral Medium 3.5 128B
Mistral Medium 3.5 128B leads llmrun Score 102.1 to 82.5; neither fits 24 GB.
Run Mistral Medium 3.5 128B in the cloud →
Model A · Mistral AI
Mistral Large Instruct 2411122.6B · 128K context · Other · Nov 2024
Model B · Mistral AI
Mistral Medium 3.5 128B127.7B · 256K context · Other · Mar 2026
Choose Mistral Medium 3.5 128B if you want…
Higher llmrun Score
102.1 vs 82.5
Stronger at reasoning
101.5 vs 86.9
Longer context window
256K vs 128K tokens
Also does function-calling
Mistral Large Instruct 2411 doesn't list it
Newer release
Mar 2026 vs Nov 2024
Mistral Large Instruct 2411: no clear edge over Mistral Medium 3.5 128B in the data we have.
On your hardware
Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.
8 GB
RTX 4060 · 8 GB tier
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
Doesn't fit
smallest quant needs 41.3 GB
12 GB
RTX 3060 12GB · 12 GB tier
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
Doesn't fit
smallest quant needs 41.3 GB
16 GB
RTX 5060 Ti 16GB · 16 GB tier
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
Doesn't fit
smallest quant needs 41.3 GB
24 GBreference
RTX 4090 · 24 GB tier
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
Doesn't fit
smallest quant needs 41.3 GB
32 GB
RTX 5090 · 32 GB tier
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
Doesn't fit
smallest quant needs 41.3 GB
48 GB
RTX A6000 · 48 GB tier
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
IQ2_S · ~12 tok/s
46.1 GB · up to 16Kfits
Mac 32 GB
Mac Mini M4 · Macs
Mistral Large Instruct 2411
Doesn't fit
smallest quant needs 58.3 GB
Mistral Medium 3.5 128B
Doesn't fit
smallest quant needs 41.3 GB
Mac 64 GB
Mac Studio M4 Max · Macs
Mistral Large Instruct 2411
Q3_K_S · ~7 tok/s
59.9 GB · up to 16K
Mistral Medium 3.5 128B
IQ3_S · ~7 tok/s
60.5 GB · up to 16K
Mac 128 GB
Mac Studio M4 Max · Macs
Mistral Large Instruct 2411
Q4_K_M · ~5 tok/s
79.8 GB · up to 128K
Mistral Medium 3.5 128B
Q4_K_M · ~5 tok/s
82.8 GB · up to 128K
Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).
Overall
Mistral Large Instruct 2411
Mistral Medium 3.5 128B
Coding
Mistral Large Instruct 2411
no data
Mistral Medium 3.5 128B
Science
Mistral Large Instruct 2411
no data
Mistral Medium 3.5 128B
Reasoning
Mistral Large Instruct 2411
Mistral Medium 3.5 128B
Mistral Large Instruct 2411 · #83 of 106 open models · #40 of 62 that fit ≤96 GB
Mistral Medium 3.5 128B · #53 of 106 open models · #20 of 62 that fit ≤96 GB
Benchmarks
1 shared board: Mistral Large Instruct 2411 leads 0, Mistral Medium 3.5 128B leads 1 · Benchmarks imported Nov 2026
Mistral Large Instruct 2411
60.8%#48/70 open
Lab-reportedEpoch AI · Nov 2024
Mistral Medium 3.5 128B
75.5%#30/70 open
Lab-reportedEpoch AI · Apr 2026
15 more boards (other shared and single-model boards)
Mistral Large Instruct 2411
1305.6#104/188 open
ArenaLMArena · Oct 2026
Mistral Medium 3.5 128B
1426.4#28/188 open
ArenaLMArena · Oct 2026
Only Mistral Large Instruct 2411 (5)
- GPQA Diamond51.3%
- AIME 2024/20257.8%
- MMLU-Pro67.9%
- MATH Level 550.3%
- ForecastBench61.5
Only Mistral Medium 3.5 128B (9)
- LMArena WebDev1264.0
- SciCode40.2%
- WeirdML43.7%
- FrontierCode8.0%
- CritPt0.0%
- LMCA26.1%
- ALE-Bench764.0
- Surface Evolver Bench26.9%
- ProofBench9.0%
VRAM by quantization
Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.
Q2_K
Mistral Large Instruct 2411
53.2 GB45.2 GB file
32K 64.2 GB · 128K 99.7 GB
Mistral Medium 3.5 128B
55.3 GB46.6 GB file
32K 66.4 GB · 128K 102 GB
Q3_K_S
Mistral Large Instruct 2411
54.7 GB52.8 GB file
32K 65.8 GB · 128K 101 GB
Mistral Medium 3.5 128B
56.9 GB54.4 GB file
32K 68.0 GB · 128K 103 GB
Q3_K_M
Mistral Large Instruct 2411
60.8 GB59.1 GB file
32K 71.9 GB · 128K 107 GB
Mistral Medium 3.5 128B
63.3 GB60.6 GB file
32K 74.4 GB · 128K 110 GB
Q4_0
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
64.9 GB71.0 GB file
32K 76.0 GB · 128K 111 GB
Q4_K_M
Mistral Large Instruct 2411
74.6 GB73.2 GB file
32K 85.7 GB · 128K 121 GB
Mistral Medium 3.5 128B
77.7 GB74.9 GB file
32K 88.7 GB · 128K 124 GB
Q5_K_M
Mistral Large Instruct 2411
88.4 GB86.5 GB file
32K 99.5 GB · 128K 135 GB
Mistral Medium 3.5 128B
92.0 GB88.3 GB file
32K 103 GB · 128K 139 GB
Q6_K
Mistral Large Instruct 2411
102 GB~101.2 GB file
32K 113 GB · 128K 149 GB
Mistral Medium 3.5 128B
106 GB102.6 GB file
32K 117 GB · 128K 153 GB
Q8_0
Mistral Large Instruct 2411
124 GB~122.6 GB file
32K 135 GB · 128K 170 GB
Mistral Medium 3.5 128B
129 GB132.9 GB file
32K 140 GB · 128K 175 GB
18 more quants
IQ2_XXS
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
36.2 GB34.9 GB file
32K 47.2 GB · 128K 82.7 GB
IQ2_XS
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
39.4 GB43.4 GB file
32K 50.4 GB · 128K 85.9 GB
IQ2_S
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
41.0 GB46.1 GB file
32K 52.0 GB · 128K 87.5 GB
IQ2_M
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
44.1 GB44.1 GB file
32K 55.2 GB · 128K 90.7 GB
IQ3_XXS
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
50.5 GB49.3 GB file
32K 61.6 GB · 128K 97.0 GB
Q2_K_S
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
52.1 GB43.0 GB file
32K 63.2 GB · 128K 98.6 GB
IQ3_XS
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
53.7 GB54.9 GB file
32K 64.8 GB · 128K 100 GB
IQ3_S
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
55.3 GB54.5 GB file
32K 66.4 GB · 128K 102 GB
IQ3_M
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
58.5 GB59.5 GB file
32K 69.6 GB · 128K 105 GB
Q3_K_L
Mistral Large Instruct 2411
63.9 GB64.6 GB file
32K 75.0 GB · 128K 110 GB
Mistral Medium 3.5 128B
66.5 GB67.0 GB file
32K 77.6 GB · 128K 113 GB
IQ4_XS
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
69.7 GB67.1 GB file
32K 80.8 GB · 128K 116 GB
IQ4_NL
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
72.9 GB70.9 GB file
32K 83.9 GB · 128K 119 GB
Q4_1
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
72.9 GB78.5 GB file
32K 83.9 GB · 128K 119 GB
Q4_K_S
Mistral Large Instruct 2411
70.0 GB69.6 GB file
32K 81.1 GB · 128K 117 GB
Mistral Medium 3.5 128B
72.9 GB71.2 GB file
32K 83.9 GB · 128K 119 GB
Q4_K_L
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
79.3 GB79.6 GB file
32K 90.3 GB · 128K 126 GB
Q5_K_S
Mistral Large Instruct 2411
85.3 GB84.4 GB file
32K 96.4 GB · 128K 132 GB
Mistral Medium 3.5 128B
88.8 GB86.2 GB file
32K 99.9 GB · 128K 135 GB
Q5_K_L
Mistral Large Instruct 2411
not listed
Mistral Medium 3.5 128B
93.6 GB92.1 GB file
32K 105 GB · 128K 140 GB
BF16
Mistral Large Instruct 2411
246 GB~245.2 GB file
32K 257 GB · 128K 293 GB
Mistral Medium 3.5 128B
256 GB250.1 GB file
32K 268 GB · 128K 303 GB
Mistral Large Instruct 2411
Ollama · Q4_K_M
ollama run hf.co/MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF:Q4_K_MMistral Medium 3.5 128B
Ollama · Q4_K_M
ollama run hf.co/unsloth/Mistral-Medium-3.5-128B-GGUF:Q4_K_M| Spec | Mistral Large Instruct 2411 | Mistral Medium 3.5 128B |
|---|---|---|
| Publisher | Mistral AI | Mistral AI |
| Parameters | 122.6B | 127.7B |
| Architecture | MistralForCausalLM | Mistral3ForConditionalGeneration |
| Context | 128K tokens | 256K tokens |
| Modalities | Chat | Chat, Function-calling |
| License | Other | Other |
| Released | Nov 2024 | Mar 2026 |
Frequently Asked Questions
Which is better, Mistral Large Instruct 2411 or Mistral Medium 3.5 128B?
Mistral Medium 3.5 128B leads llmrun Score 102.1 to 82.5; neither fits 24 GB. Choose Mistral Medium 3.5 128B for higher llmrun Score and stronger at reasoning.
Which needs less VRAM, Mistral Large Instruct 2411 or Mistral Medium 3.5 128B?
At Q4_K_M, Mistral Large Instruct 2411 requires 74.6 GB while Mistral Medium 3.5 128B needs 77.7 GB, making Mistral Large Instruct 2411 the easier model to run on your local setup.
Can I run Mistral Large Instruct 2411 or Mistral Medium 3.5 128B on a 16 GB GPU?
Mistral Large Instruct 2411 does not fit (smallest quant needs 58.3 GB); Mistral Medium 3.5 128B does not fit (smallest quant needs 41.3 GB).
Which has a longer context window, Mistral Large Instruct 2411 or Mistral Medium 3.5 128B?
Mistral Large Instruct 2411 supports 131,072 tokens and Mistral Medium 3.5 128B supports 262,144 tokens.