Mistral Medium 3.5 128B vs NVIDIA Nemotron 3 Super 120B A12B BF16

Mistral Medium 3.5 128B leads llmrun Score 102.1 to 95.8 (ranges overlap); neither fits 24 GB.

Run Mistral Medium 3.5 128B in the cloud →

Model A · Mistral AI

Mistral Medium 3.5 128B

102.1llmrun Score

127.7B · 256K context · Other · Mar 2026

ChatFunctions

Model B · NVIDIA

NVIDIA Nemotron 3 Super 120B A12B BF16

95.8llmrun Score

123.6B · 13B active · 256K context · Other · Mar 2026

ChatFunctions

Which should you choose?

Choose Mistral Medium 3.5 128B if you want…

Higher llmrun Score
102.1 vs 95.8, ranges overlap
Stronger at coding
102.2 vs 95.6
Ahead on the benchmarks
3 of 4 shared boards

NVIDIA Nemotron 3 Super 120B A12B BF16: no clear edge over Mistral Medium 3.5 128B in the data we have.

On your hardware

Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.

MemoryMistral Medium 3.5 128BNVIDIA Nemotron 3 Super 120B A12B BF16

8 GB

RTX 4060 · 8 GB tier

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

Doesn't fit

smallest quant needs 34.5 GB

12 GB

RTX 3060 12GB · 12 GB tier

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

Doesn't fit

smallest quant needs 34.5 GB

16 GB

RTX 5060 Ti 16GB · 16 GB tier

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

Doesn't fit

smallest quant needs 34.5 GB

24 GBreference

RTX 4090 · 24 GB tier

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

Doesn't fit

smallest quant needs 34.5 GB

32 GB

RTX 5090 · 32 GB tier

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

Doesn't fit

smallest quant needs 34.5 GB

48 GB

RTX A6000 · 48 GB tier

Mistral Medium 3.5 128B

IQ2_S · ~12 tok/s

46.1 GB · up to 16K

NVIDIA Nemotron 3 Super 120B A12B BF16

IQ2_M · ~73 tok/s

42.2 GB · up to 256K

Mac 32 GB

Mac Mini M4 · Macs

Mistral Medium 3.5 128B

Doesn't fit

smallest quant needs 41.3 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

Doesn't fit

smallest quant needs 34.5 GB

Mac 64 GB

Mac Studio M4 Max · Macs

Mistral Medium 3.5 128B

IQ3_S · ~7 tok/s

60.5 GB · up to 16K

NVIDIA Nemotron 3 Super 120B A12B BF16

IQ3_M · ~30 tok/s

56.1 GB · up to 256K

Mac 128 GB

Mac Studio M4 Max · Macs

Mistral Medium 3.5 128B

Q4_K_M · ~5 tok/s

82.8 GB · up to 128K

NVIDIA Nemotron 3 Super 120B A12B BF16

Q4_K_M · ~26 tok/s

74.7 GB · up to 256Kfaster

Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).

llmrun Score

with its 90% range · bars share one scale

Mistral Medium 3.5 128B NVIDIA Nemotron 3 Super 120B A12B BF16

Overall

Mistral Medium 3.5 128B

102.197–107

NVIDIA Nemotron 3 Super 120B A12B BF16

95.886–106

Coding

Mistral Medium 3.5 128B

102.296–108

NVIDIA Nemotron 3 Super 120B A12B BF16

95.686–106

Science

Mistral Medium 3.5 128B

101.380–123

NVIDIA Nemotron 3 Super 120B A12B BF16

97.675–120

Reasoning

Mistral Medium 3.5 128B

101.593–110

NVIDIA Nemotron 3 Super 120B A12B BF16

no data

Mistral Medium 3.5 128B · #53 of 106 open models · #20 of 62 that fit ≤96 GB

NVIDIA Nemotron 3 Super 120B A12B BF16 · #71 of 106 open models · #33 of 62 that fit ≤96 GB

Benchmarks

4 shared boards: Mistral Medium 3.5 128B leads 3, NVIDIA Nemotron 3 Super 120B A12B BF16 leads 1 · Benchmarks imported Nov 2026

BoardMistral Medium 3.5 128BNVIDIA Nemotron 3 Super 120B A12B BF16

SciCode

Mistral Medium 3.5 128B

40.2%#36/72 open

Lab-reportedEpoch AI · Apr 2026

NVIDIA Nemotron 3 Super 120B A12B BF16

36.0%#50/72 open

Lab-reportedEpoch AI · Mar 2026

WeirdML

Mistral Medium 3.5 128B

43.7%#16/47 open

IndependentEpoch AI · Apr 2026

NVIDIA Nemotron 3 Super 120B A12B BF16

38.0%#29/47 open

IndependentEpoch AI · Mar 2026

ALE-Bench

Mistral Medium 3.5 128B

764.0#24/48 open

Lab-reportedEpoch AI · Apr 2026

NVIDIA Nemotron 3 Super 120B A12B BF16

213.9#47/48 open

Lab-reportedEpoch AI · Mar 2026

CritPt

Mistral Medium 3.5 128B

0.0%#73/84 open

Lab-reportedEpoch AI · Apr 2026

NVIDIA Nemotron 3 Super 120B A12B BF16

3.1%#28/84 open

Lab-reportedEpoch AI · Mar 2026

7 more boards (other shared and single-model boards)

LMArena Text

Mistral Medium 3.5 128B

1426.4#28/188 open

ArenaLMArena · Oct 2026

NVIDIA Nemotron 3 Super 120B A12B BF16

1359.9#70/188 open

ArenaLMArena · Oct 2026

Only Mistral Medium 3.5 128B (6)

VRAM by quantization

Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.

QuantMistral Medium 3.5 128BNVIDIA Nemotron 3 Super 120B A12B BF16

Q2_K

Mistral Medium 3.5 128B

55.3 GB46.6 GB file

32K 66.4 GB · 128K 102 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

53.0 GB54.8 GB file

32K 53.2 GB · 128K 54.3 GB

Q3_K_S

Mistral Medium 3.5 128B

56.9 GB54.4 GB file

32K 68.0 GB · 128K 103 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

54.6 GB61.7 GB file

32K 54.7 GB · 128K 55.9 GB

Q3_K_M

Mistral Medium 3.5 128B

63.3 GB60.6 GB file

32K 74.4 GB · 128K 110 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

60.7 GB61.7 GB file

32K 60.9 GB · 128K 62.0 GB

Q4_0

Mistral Medium 3.5 128B

64.9 GB71.0 GB file

32K 76.0 GB · 128K 111 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

62.3 GB71.0 GB file

32K 62.5 GB · 128K 63.6 GB

Q4_K_M

Mistral Medium 3.5 128B

77.7 GB74.9 GB file

32K 88.7 GB · 128K 124 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

74.7 GB82.5 GB file

32K 74.8 GB · 128K 75.9 GB

Q5_K_M

Mistral Medium 3.5 128B

92.0 GB88.3 GB file

32K 103 GB · 128K 139 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

88.6 GB107.3 GB file

32K 88.7 GB · 128K 89.9 GB

Q6_K

Mistral Medium 3.5 128B

106 GB102.6 GB file

32K 117 GB · 128K 153 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

102 GB114.8 GB file

32K 103 GB · 128K 104 GB

Q8_0

Mistral Medium 3.5 128B

129 GB132.9 GB file

32K 140 GB · 128K 175 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

124 GB128.5 GB file

32K 124 GB · 128K 125 GB

18 more quants

IQ2_XXS

Mistral Medium 3.5 128B

36.2 GB34.9 GB file

32K 47.2 GB · 128K 82.7 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

34.5 GB~34.0 GB file

32K 34.7 GB · 128K 35.8 GB

IQ2_XS

Mistral Medium 3.5 128B

39.4 GB43.4 GB file

32K 50.4 GB · 128K 85.9 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

37.6 GB52.0 GB file

32K 37.8 GB · 128K 38.9 GB

IQ2_S

Mistral Medium 3.5 128B

41.0 GB46.1 GB file

32K 52.0 GB · 128K 87.5 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

39.1 GB52.1 GB file

32K 39.3 GB · 128K 40.4 GB

IQ2_M

Mistral Medium 3.5 128B

44.1 GB44.1 GB file

32K 55.2 GB · 128K 90.7 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

42.2 GB52.7 GB file

32K 42.4 GB · 128K 43.5 GB

IQ3_XXS

Mistral Medium 3.5 128B

50.5 GB49.3 GB file

32K 61.6 GB · 128K 97.0 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

48.4 GB56.6 GB file

32K 48.6 GB · 128K 49.7 GB

Q2_K_S

Mistral Medium 3.5 128B

52.1 GB43.0 GB file

32K 63.2 GB · 128K 98.6 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

not listed

IQ3_XS

Mistral Medium 3.5 128B

53.7 GB54.9 GB file

32K 64.8 GB · 128K 100 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

51.5 GB64.5 GB file

32K 51.7 GB · 128K 52.8 GB

IQ3_S

Mistral Medium 3.5 128B

55.3 GB54.5 GB file

32K 66.4 GB · 128K 102 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

53.0 GB56.6 GB file

32K 53.2 GB · 128K 54.3 GB

IQ3_M

Mistral Medium 3.5 128B

58.5 GB59.5 GB file

32K 69.6 GB · 128K 105 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

56.1 GB66.3 GB file

32K 56.3 GB · 128K 57.4 GB

Q3_K_L

Mistral Medium 3.5 128B

66.5 GB67.0 GB file

32K 77.6 GB · 128K 113 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

63.8 GB66.4 GB file

32K 64.0 GB · 128K 65.1 GB

IQ4_XS

Mistral Medium 3.5 128B

69.7 GB67.1 GB file

32K 80.8 GB · 128K 116 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

66.9 GB64.5 GB file

32K 67.1 GB · 128K 68.2 GB

IQ4_NL

Mistral Medium 3.5 128B

72.9 GB70.9 GB file

32K 83.9 GB · 128K 119 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

70.0 GB64.5 GB file

32K 70.2 GB · 128K 71.3 GB

Q4_1

Mistral Medium 3.5 128B

72.9 GB78.5 GB file

32K 83.9 GB · 128K 119 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

70.0 GB76.6 GB file

32K 70.2 GB · 128K 71.3 GB

Q4_K_S

Mistral Medium 3.5 128B

72.9 GB71.2 GB file

32K 83.9 GB · 128K 119 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

70.0 GB79.0 GB file

32K 70.2 GB · 128K 71.3 GB

Q4_K_L

Mistral Medium 3.5 128B

79.3 GB79.6 GB file

32K 90.3 GB · 128K 126 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

76.2 GB87.4 GB file

32K 76.4 GB · 128K 77.5 GB

Q5_K_S

Mistral Medium 3.5 128B

88.8 GB86.2 GB file

32K 99.9 GB · 128K 135 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

85.5 GB89.7 GB file

32K 85.7 GB · 128K 86.8 GB

Q5_K_L

Mistral Medium 3.5 128B

93.6 GB92.1 GB file

32K 105 GB · 128K 140 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

90.1 GB96.9 GB file

32K 90.3 GB · 128K 91.4 GB

BF16

Mistral Medium 3.5 128B

256 GB250.1 GB file

32K 268 GB · 128K 303 GB

NVIDIA Nemotron 3 Super 120B A12B BF16

248 GB241.5 GB file

32K 248 GB · 128K 249 GB

How to run each

Mistral Medium 3.5 128B

Ollama · Q4_K_M

$ollama run hf.co/unsloth/Mistral-Medium-3.5-128B-GGUF:Q4_K_M

All ways to run Mistral Medium 3.5 128B →

NVIDIA Nemotron 3 Super 120B A12B BF16

Ollama · Q4_K_M

$ollama run hf.co/unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF:Q4_K_M

All ways to run NVIDIA Nemotron 3 Super 120B A12B BF16 →

Specifications

Specifications of Mistral Medium 3.5 128B and NVIDIA Nemotron 3 Super 120B A12B BF16
Spec	Mistral Medium 3.5 128B	NVIDIA Nemotron 3 Super 120B A12B BF16
Publisher	Mistral AI	NVIDIA
Parameters	127.7B	123.6B
Active parameters	—	13B per token
Architecture	Mistral3ForConditionalGeneration	NemotronHForCausalLM
Context	256K tokens	256K tokens
Modalities	Chat, Function-calling	Chat, Function-calling
License	Other	Other
Released	Mar 2026	Mar 2026

Frequently Asked Questions

Which is better, Mistral Medium 3.5 128B or NVIDIA Nemotron 3 Super 120B A12B BF16?

Mistral Medium 3.5 128B leads llmrun Score 102.1 to 95.8 (ranges overlap); neither fits 24 GB. Choose Mistral Medium 3.5 128B for higher llmrun Score and stronger at coding.

Which needs less VRAM, Mistral Medium 3.5 128B or NVIDIA Nemotron 3 Super 120B A12B BF16?

At Q4_K_M, Mistral Medium 3.5 128B requires 77.7 GB while NVIDIA Nemotron 3 Super 120B A12B BF16 needs 74.7 GB, making NVIDIA Nemotron 3 Super 120B A12B BF16 the easier model to run on your local setup.

Can I run Mistral Medium 3.5 128B or NVIDIA Nemotron 3 Super 120B A12B BF16 on a 16 GB GPU?

Mistral Medium 3.5 128B does not fit (smallest quant needs 41.3 GB); NVIDIA Nemotron 3 Super 120B A12B BF16 does not fit (smallest quant needs 34.5 GB).

Which has a longer context window, Mistral Medium 3.5 128B or NVIDIA Nemotron 3 Super 120B A12B BF16?

Mistral Medium 3.5 128B supports 262,144 tokens and NVIDIA Nemotron 3 Super 120B A12B BF16 supports 262,144 tokens.