llmrun

Mistral Large Instruct 2411 vs Qwen2.5 72B Instruct

Mistral Large Instruct 2411 and Qwen2.5 72B Instruct match in llmrun Score, with values of 82.5 versus 82.2; neither fits 24 GB.

Run Mistral Large Instruct 2411 in the cloud →

122.6B · 128K context · Other · Nov 2024

Chat

72.7B · 32K context · Other · Sep 2024

ChatFunctions

Which should you choose?

Choose Mistral Large Instruct 2411 if you want…

  • Longer context window

    128K vs 32K tokens

Choose Qwen2.5 72B Instruct if you want…

  • Ahead on the benchmarks

    4 of 6 shared boards

  • Fits a 48 GB GPU

    Q4_K_M · 49.3 GB; Mistral Large Instruct 2411 needs 58.3 GB at its smallest quant

  • Lighter on memory

    44.6 vs 74.6 GB at Q4_K_M

  • Also does function-calling

    Mistral Large Instruct 2411 doesn't list it

On your hardware

Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.

8 GB

RTX 4060 · 8 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

Doesn't fit

smallest quant needs 25.7 GB

12 GB

RTX 3060 12GB · 12 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

Doesn't fit

smallest quant needs 25.7 GB

16 GB

RTX 5060 Ti 16GB · 16 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

Doesn't fit

smallest quant needs 25.7 GB

24 GBreference

RTX 4090 · 24 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

Doesn't fit

smallest quant needs 25.7 GB

32 GB

RTX 5090 · 32 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

IQ2_M · ~46 tok/s

30.2 GB · up to 16Kfits

48 GB

RTX A6000 · 48 GB tier

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

Q4_K_M · ~11 tok/stight

49.3 GB · up to 8Kfits

Mac 32 GB

Mac Mini M4 · Macs

Mistral Large Instruct 2411

Doesn't fit

smallest quant needs 58.3 GB

Qwen2.5 72B Instruct

IQ2_S · ~4 tok/s

28.4 GB · up to 16Kfits

Mac 64 GB

Mac Studio M4 Max · Macs

Mistral Large Instruct 2411

Q3_K_S · ~7 tok/s

59.9 GB · up to 16K

Qwen2.5 72B Instruct

Q4_K_M · ~9 tok/s

49.3 GB · up to 32Kmore headroom

Mac 128 GB

Mac Studio M4 Max · Macs

Mistral Large Instruct 2411

Q4_K_M · ~5 tok/s

79.8 GB · up to 128K

Qwen2.5 72B Instruct

Q4_K_M · ~9 tok/s

49.3 GB · up to 32Kfaster

Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).

llmrun Score

with its 90% range · bars share one scale

Overall

Mistral Large Instruct 2411

82.578–87

Qwen2.5 72B Instruct

82.278–87

Reasoning

Mistral Large Instruct 2411

86.977–96

Qwen2.5 72B Instruct

88.079–97

Mistral Large Instruct 2411 · #83 of 106 open models · #40 of 62 that fit ≤96 GB

Qwen2.5 72B Instruct · #84 of 106 open models · #30 of 51 that fit ≤64 GB

Benchmarks

6 shared boards: Mistral Large Instruct 2411 leads 1, Qwen2.5 72B Instruct leads 4 · Benchmarks imported Nov 2026

Mistral Large Instruct 2411

51.3%#54/100 open

IndependentEpoch AI · Nov 2024

Qwen2.5 72B Instruct

49.1%#56/100 open

IndependentEpoch AI · Sep 2024

Mistral Large Instruct 2411

7.8%#65/88 open

IndependentEpoch AI · Nov 2024

Qwen2.5 72B Instruct

8.1%#62/88 open

IndependentEpoch AI · Sep 2024

Mistral Large Instruct 2411

67.9%#42/146 open

IndependentTIGER-Lab

Qwen2.5 72B Instruct

71.6%#35/146 open

IndependentTIGER-Lab

Mistral Large Instruct 2411

50.3%#14/39 open

IndependentEpoch AI · Nov 2024

Qwen2.5 72B Instruct

63.2%#11/39 open

IndependentEpoch AI · Sep 2024

Mistral Large Instruct 2411

60.8%#48/70 open

Lab-reportedEpoch AI · Nov 2024

Qwen2.5 72B Instruct

62.9%#42/70 open

Lab-reportedEpoch AI · Sep 2024

Mistral Large Instruct 2411

61.5#13/24 open

Lab-reportedEpoch AI · Nov 2024

Qwen2.5 72B Instruct

61.6#12/24 open

Lab-reportedEpoch AI · Sep 2024

6 more boards (other shared and single-model boards)

Mistral Large Instruct 2411

1305.6#104/188 open

ArenaLMArena · Oct 2026

Qwen2.5 72B Instruct

1302.9#107/188 open

ArenaLMArena · Oct 2026

Only Qwen2.5 72B Instruct (5)

VRAM by quantization

Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.

Q2_K

Mistral Large Instruct 2411

53.2 GB45.2 GB file

32K 64.2 GB · 128K 99.7 GB

Qwen2.5 72B Instruct

31.9 GB29.8 GB file

32K 41.9 GB · 128K —

Q3_K_S

Mistral Large Instruct 2411

54.7 GB52.8 GB file

32K 65.8 GB · 128K 101 GB

Qwen2.5 72B Instruct

32.8 GB34.5 GB file

32K 42.9 GB · 128K —

Q3_K_M

Mistral Large Instruct 2411

60.8 GB59.1 GB file

32K 71.9 GB · 128K 107 GB

Qwen2.5 72B Instruct

36.4 GB37.7 GB file

32K 46.5 GB · 128K —

Q4_0

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

37.3 GB41.4 GB file

32K 47.4 GB · 128K —

Q4_K_M

Mistral Large Instruct 2411

74.6 GB73.2 GB file

32K 85.7 GB · 128K 121 GB

Qwen2.5 72B Instruct

44.6 GB47.4 GB file

32K 54.7 GB · 128K —

Q5_K_M

Mistral Large Instruct 2411

88.4 GB86.5 GB file

32K 99.5 GB · 128K 135 GB

Qwen2.5 72B Instruct

52.8 GB54.4 GB file

32K 62.8 GB · 128K —

Q6_K

Mistral Large Instruct 2411

102 GB~101.2 GB file

32K 113 GB · 128K 149 GB

Qwen2.5 72B Instruct

61.0 GB64.3 GB file

32K 71.0 GB · 128K —

Q8_0

Mistral Large Instruct 2411

124 GB~122.6 GB file

32K 135 GB · 128K 170 GB

Qwen2.5 72B Instruct

73.7 GB77.3 GB file

32K 83.8 GB · 128K —

17 more quants

IQ2_XXS

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

21.0 GB25.5 GB file

32K 31.0 GB · 128K —

IQ2_XS

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

22.8 GB27.1 GB file

32K 32.9 GB · 128K —

IQ2_S

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

23.7 GB27.9 GB file

32K 33.8 GB · 128K —

IQ2_M

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

25.5 GB29.3 GB file

32K 35.6 GB · 128K —

IQ3_XXS

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

29.1 GB31.8 GB file

32K 39.2 GB · 128K —

Q2_K_S

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

30.1 GB29.6 GB file

32K 40.1 GB · 128K —

IQ3_XS

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

31.0 GB32.8 GB file

32K 41.0 GB · 128K —

IQ3_S

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

31.9 GB34.5 GB file

32K 41.9 GB · 128K —

IQ3_M

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

33.7 GB35.5 GB file

32K 43.8 GB · 128K —

Q3_K_L

Mistral Large Instruct 2411

63.9 GB64.6 GB file

32K 75.0 GB · 128K 110 GB

Qwen2.5 72B Instruct

38.2 GB39.5 GB file

32K 48.3 GB · 128K —

IQ4_XS

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

40.1 GB39.7 GB file

32K 50.1 GB · 128K —

IQ4_NL

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

41.9 GB41.3 GB file

32K 51.9 GB · 128K —

Q4_1

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

41.9 GB45.7 GB file

32K 51.9 GB · 128K —

Q4_K_S

Mistral Large Instruct 2411

70.0 GB69.6 GB file

32K 81.1 GB · 128K 117 GB

Qwen2.5 72B Instruct

41.9 GB43.9 GB file

32K 51.9 GB · 128K —

Q5_0

Mistral Large Instruct 2411

not listed

Qwen2.5 72B Instruct

46.4 GB50.3 GB file

32K 56.5 GB · 128K —

Q5_K_S

Mistral Large Instruct 2411

85.3 GB84.4 GB file

32K 96.4 GB · 128K 132 GB

Qwen2.5 72B Instruct

51.0 GB51.4 GB file

32K 61.0 GB · 128K —

BF16

Mistral Large Instruct 2411

246 GB~245.2 GB file

32K 257 GB · 128K 293 GB

Qwen2.5 72B Instruct

146 GB~145.4 GB file

32K 156 GB · 128K —

How to run each

Specifications

Specifications of Mistral Large Instruct 2411 and Qwen2.5 72B Instruct
SpecMistral Large Instruct 2411Qwen2.5 72B Instruct
PublisherMistral AIAlibaba
Parameters122.6B72.7B
ArchitectureMistralForCausalLMQwen2ForCausalLM
Context128K tokens32K tokens
ModalitiesChatChat, Function-calling
LicenseOtherOther
ReleasedNov 2024Sep 2024

Frequently Asked Questions

Which is better, Mistral Large Instruct 2411 or Qwen2.5 72B Instruct?

Mistral Large Instruct 2411 and Qwen2.5 72B Instruct match in llmrun Score, with values of 82.5 versus 82.2; neither fits 24 GB. Choose Mistral Large Instruct 2411 for longer context window; choose Qwen2.5 72B Instruct for ahead on the benchmarks and fits a 48 GB GPU.

Which needs less VRAM, Mistral Large Instruct 2411 or Qwen2.5 72B Instruct?

At Q4_K_M, Mistral Large Instruct 2411 requires 74.6 GB while Qwen2.5 72B Instruct needs 44.6 GB, making Qwen2.5 72B Instruct the easier model to run on your local setup.

Can I run Mistral Large Instruct 2411 or Qwen2.5 72B Instruct on a 16 GB GPU?

Mistral Large Instruct 2411 does not fit (smallest quant needs 58.3 GB); Qwen2.5 72B Instruct does not fit (smallest quant needs 25.7 GB).

Which has a longer context window, Mistral Large Instruct 2411 or Qwen2.5 72B Instruct?

Mistral Large Instruct 2411 supports 131,072 tokens and Qwen2.5 72B Instruct supports 32,768 tokens.

Mistral Large Instruct 2411 vs Qwen2.5 72B Instruct — VRAM & GPU Comparison | llmrun