llmrun

Mistral Large Instruct 2411 vs Mistral Medium 3.5 128B

Mistral Medium 3.5 128B leads llmrun Score 102.1 to 82.5; neither fits 24 GB.

Run Mistral Medium 3.5 128B in the cloud →

122.6B · 128K context · Other · Nov 2024

Chat

127.7B · 256K context · Other · Mar 2026

ChatFunctions

Which should you choose?

Choose Mistral Medium 3.5 128B if you want…

  • Higher llmrun Score

    102.1 vs 82.5

  • Stronger at reasoning

    101.5 vs 86.9

  • Longer context window

    256K vs 128K tokens

  • Also does function-calling

    Mistral Large Instruct 2411 doesn't list it

  • Newer release

    Mar 2026 vs Nov 2024

Mistral Large Instruct 2411: no clear edge over Mistral Medium 3.5 128B in the data we have.

On your hardware

Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.

8 GB

RTX 4060 · 8 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

12 GB

RTX 3060 12GB · 12 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

16 GB

RTX 5060 Ti 16GB · 16 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

24 GBreference

RTX 4090 · 24 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

32 GB

RTX 5090 · 32 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

48 GB

RTX A6000 · 48 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

IQ2_S · ~12 tok/s

46.1 GB · up to 16Kfits

Mac 32 GB

Mac Mini M4 · Macs

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

Mac 64 GB

Mac Studio M4 Max · Macs

Mistral Large Instruct 2411

Q3_K_S · ~7 tok/s

59.9 GB · up to 16K

Mistral Medium 3.5 128B

IQ3_S · ~7 tok/s

60.5 GB · up to 16K

Mac 128 GB

Mac Studio M4 Max · Macs

Mistral Large Instruct 2411

Q4_K_M · ~5 tok/s

79.8 GB · up to 128K

Mistral Medium 3.5 128B

Q4_K_M · ~5 tok/s

82.8 GB · up to 128K

Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).

llmrun Score

with its 90% range · bars share one scale

Overall

Mistral Large Instruct 2411

82.578–87

Mistral Medium 3.5 128B

102.197–107

Coding

Mistral Large Instruct 2411

no data

Mistral Medium 3.5 128B

102.296–108

Science

Mistral Large Instruct 2411

no data

Mistral Medium 3.5 128B

101.380–123

Reasoning

Mistral Large Instruct 2411

86.977–96

Mistral Medium 3.5 128B

101.593–110

Mistral Large Instruct 2411 · #83 of 106 open models · #40 of 62 that fit ≤96 GB

Mistral Medium 3.5 128B · #53 of 106 open models · #20 of 62 that fit ≤96 GB

Benchmarks

1 shared board: Mistral Large Instruct 2411 leads 0, Mistral Medium 3.5 128B leads 1 · Benchmarks imported Nov 2026

Mistral Large Instruct 2411

60.8%#48/70 open

Lab-reportedEpoch AI · Nov 2024

Mistral Medium 3.5 128B

75.5%#30/70 open

Lab-reportedEpoch AI · Apr 2026

15 more boards (other shared and single-model boards)

Mistral Large Instruct 2411

1305.6#104/188 open

ArenaLMArena · Oct 2026

Mistral Medium 3.5 128B

1426.4#28/188 open

ArenaLMArena · Oct 2026

Only Mistral Large Instruct 2411 (5)

Only Mistral Medium 3.5 128B (9)

VRAM by quantization

Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.

Q2_K

Mistral Large Instruct 2411

53.2 GB45.2 GB file

32K 64.2 GB · 128K 99.7 GB

Mistral Medium 3.5 128B

55.3 GB46.6 GB file

32K 66.4 GB · 128K 102 GB

Q3_K_S

Mistral Large Instruct 2411

54.7 GB52.8 GB file

32K 65.8 GB · 128K 101 GB

Mistral Medium 3.5 128B

56.9 GB54.4 GB file

32K 68.0 GB · 128K 103 GB

Q3_K_M

Mistral Large Instruct 2411

60.8 GB59.1 GB file

32K 71.9 GB · 128K 107 GB

Mistral Medium 3.5 128B

63.3 GB60.6 GB file

32K 74.4 GB · 128K 110 GB

Q4_0

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

64.9 GB71.0 GB file

32K 76.0 GB · 128K 111 GB

Q4_K_M

Mistral Large Instruct 2411

74.6 GB73.2 GB file

32K 85.7 GB · 128K 121 GB

Mistral Medium 3.5 128B

77.7 GB74.9 GB file

32K 88.7 GB · 128K 124 GB

Q5_K_M

Mistral Large Instruct 2411

88.4 GB86.5 GB file

32K 99.5 GB · 128K 135 GB

Mistral Medium 3.5 128B

92.0 GB88.3 GB file

32K 103 GB · 128K 139 GB

Q6_K

Mistral Large Instruct 2411

102 GB~101.2 GB file

32K 113 GB · 128K 149 GB

Mistral Medium 3.5 128B

106 GB102.6 GB file

32K 117 GB · 128K 153 GB

Q8_0

Mistral Large Instruct 2411

124 GB~122.6 GB file

32K 135 GB · 128K 170 GB

Mistral Medium 3.5 128B

129 GB132.9 GB file

32K 140 GB · 128K 175 GB

18 more quants

IQ2_XXS

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

36.2 GB34.9 GB file

32K 47.2 GB · 128K 82.7 GB

IQ2_XS

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

39.4 GB43.4 GB file

32K 50.4 GB · 128K 85.9 GB

IQ2_S

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

41.0 GB46.1 GB file

32K 52.0 GB · 128K 87.5 GB

IQ2_M

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

44.1 GB44.1 GB file

32K 55.2 GB · 128K 90.7 GB

IQ3_XXS

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

50.5 GB49.3 GB file

32K 61.6 GB · 128K 97.0 GB

Q2_K_S

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

52.1 GB43.0 GB file

32K 63.2 GB · 128K 98.6 GB

IQ3_XS

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

53.7 GB54.9 GB file

32K 64.8 GB · 128K 100 GB

IQ3_S

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

55.3 GB54.5 GB file

32K 66.4 GB · 128K 102 GB

IQ3_M

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

58.5 GB59.5 GB file

32K 69.6 GB · 128K 105 GB

Q3_K_L

Mistral Large Instruct 2411

63.9 GB64.6 GB file

32K 75.0 GB · 128K 110 GB

Mistral Medium 3.5 128B

66.5 GB67.0 GB file

32K 77.6 GB · 128K 113 GB

IQ4_XS

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

69.7 GB67.1 GB file

32K 80.8 GB · 128K 116 GB

IQ4_NL

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

72.9 GB70.9 GB file

32K 83.9 GB · 128K 119 GB

Q4_1

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

72.9 GB78.5 GB file

32K 83.9 GB · 128K 119 GB

Q4_K_S

Mistral Large Instruct 2411

70.0 GB69.6 GB file

32K 81.1 GB · 128K 117 GB

Mistral Medium 3.5 128B

72.9 GB71.2 GB file

32K 83.9 GB · 128K 119 GB

Q4_K_L

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

79.3 GB79.6 GB file

32K 90.3 GB · 128K 126 GB

Q5_K_S

Mistral Large Instruct 2411

85.3 GB84.4 GB file

32K 96.4 GB · 128K 132 GB

Mistral Medium 3.5 128B

88.8 GB86.2 GB file

32K 99.9 GB · 128K 135 GB

Q5_K_L

Mistral Large Instruct 2411

not listed

Mistral Medium 3.5 128B

93.6 GB92.1 GB file

32K 105 GB · 128K 140 GB

BF16

Mistral Large Instruct 2411

246 GB~245.2 GB file

32K 257 GB · 128K 293 GB

Mistral Medium 3.5 128B

256 GB250.1 GB file

32K 268 GB · 128K 303 GB

How to run each

Specifications

Specifications of Mistral Large Instruct 2411 and Mistral Medium 3.5 128B
SpecMistral Large Instruct 2411Mistral Medium 3.5 128B
PublisherMistral AIMistral AI
Parameters122.6B127.7B
ArchitectureMistralForCausalLMMistral3ForConditionalGeneration
Context128K tokens256K tokens
ModalitiesChatChat, Function-calling
LicenseOtherOther
ReleasedNov 2024Mar 2026

Frequently Asked Questions

Which is better, Mistral Large Instruct 2411 or Mistral Medium 3.5 128B?

Mistral Medium 3.5 128B leads llmrun Score 102.1 to 82.5; neither fits 24 GB. Choose Mistral Medium 3.5 128B for higher llmrun Score and stronger at reasoning.

Which needs less VRAM, Mistral Large Instruct 2411 or Mistral Medium 3.5 128B?

At Q4_K_M, Mistral Large Instruct 2411 requires 74.6 GB while Mistral Medium 3.5 128B needs 77.7 GB, making Mistral Large Instruct 2411 the easier model to run on your local setup.

Can I run Mistral Large Instruct 2411 or Mistral Medium 3.5 128B on a 16 GB GPU?

Mistral Large Instruct 2411 does not fit (smallest quant needs 58.3 GB); Mistral Medium 3.5 128B does not fit (smallest quant needs 41.3 GB).

Which has a longer context window, Mistral Large Instruct 2411 or Mistral Medium 3.5 128B?

Mistral Large Instruct 2411 supports 131,072 tokens and Mistral Medium 3.5 128B supports 262,144 tokens.

Mistral Large Instruct 2411 vs Mistral Medium 3.5 128B — VRAM & GPU Comparison | llmrun