Mistral Small 4 119B 2603 vs NVIDIA Nemotron 3 Super 120B A12B BF16
Mistral Small 4 119B 2603 and NVIDIA Nemotron 3 Super 120B A12B BF16 match in llmrun Score, with values of 96.4 versus 95.8; neither fits 24 GB.
Model A · Mistral AI
Mistral Small 4 119B 2603119.4B · 7.1B active · 1M context · Apache 2.0 · Jan 2026
Model B · NVIDIA
NVIDIA Nemotron 3 Super 120B A12B BF16123.6B · 13B active · 256K context · Other · Mar 2026
Choose Mistral Small 4 119B 2603 if you want…
Longer context window
1M vs 256K tokens
More permissive license
Apache 2.0 vs Other
NVIDIA Nemotron 3 Super 120B A12B BF16: no clear edge over Mistral Small 4 119B 2603 in the data we have.
On your hardware
Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.
8 GB
RTX 4060 · 8 GB tier
Mistral Small 4 119B 2603
Doesn't fit
smallest quant needs 42.8 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
12 GB
RTX 3060 12GB · 12 GB tier
Mistral Small 4 119B 2603
Doesn't fit
smallest quant needs 42.8 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
16 GB
RTX 5060 Ti 16GB · 16 GB tier
Mistral Small 4 119B 2603
Doesn't fit
smallest quant needs 42.8 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
24 GBreference
RTX 4090 · 24 GB tier
Mistral Small 4 119B 2603
Doesn't fit
smallest quant needs 42.8 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
32 GB
RTX 5090 · 32 GB tier
Mistral Small 4 119B 2603
Doesn't fit
smallest quant needs 42.8 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
48 GB
RTX A6000 · 48 GB tier
Mistral Small 4 119B 2603
IQ2_S · ~152 tok/s
47.3 GB · up to 16K
NVIDIA Nemotron 3 Super 120B A12B BF16
IQ2_M · ~73 tok/s
42.2 GB · up to 256K
Mac 32 GB
Mac Mini M4 · Macs
Mistral Small 4 119B 2603
Doesn't fit
smallest quant needs 42.8 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
Mac 64 GB
Mac Studio M4 Max · Macs
Mistral Small 4 119B 2603
IQ3_XS · ~66 tok/s
59.2 GB · up to 16K
NVIDIA Nemotron 3 Super 120B A12B BF16
IQ3_M · ~30 tok/s
56.1 GB · up to 256K
Mac 128 GB
Mac Studio M4 Max · Macs
Mistral Small 4 119B 2603
Q4_K_M · ~54 tok/s
81.6 GB · up to 64Kfaster
NVIDIA Nemotron 3 Super 120B A12B BF16
Q4_K_M · ~26 tok/s
74.7 GB · up to 256K
Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).
Overall
Mistral Small 4 119B 2603
NVIDIA Nemotron 3 Super 120B A12B BF16
Coding
Mistral Small 4 119B 2603
no data
NVIDIA Nemotron 3 Super 120B A12B BF16
Science
Mistral Small 4 119B 2603
no data
NVIDIA Nemotron 3 Super 120B A12B BF16
Reasoning
Mistral Small 4 119B 2603
NVIDIA Nemotron 3 Super 120B A12B BF16
no data
Mistral Small 4 119B 2603 · #61 of 100 open models · #28 of 60 that fit ≤96 GB
NVIDIA Nemotron 3 Super 120B A12B BF16 · #65 of 100 open models · #32 of 60 that fit ≤96 GB
Benchmarks
1 shared board: Mistral Small 4 119B 2603 leads 1, NVIDIA Nemotron 3 Super 120B A12B BF16 leads 0 · Benchmarks imported Oct 2026
Mistral Small 4 119B 2603
497.6#32/43 open
Lab-reportedEpoch AI · Mar 2026
NVIDIA Nemotron 3 Super 120B A12B BF16
213.9#42/43 open
Lab-reportedEpoch AI · Mar 2026
VRAM by quantization
Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.
Q2_K
Mistral Small 4 119B 2603
52.3 GB42.1 GB file
32K 70.4 GB · 128K 128 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
53.0 GB54.8 GB file
32K 53.2 GB · 128K 54.3 GB
Q3_K_S
Mistral Small 4 119B 2603
53.8 GB52.0 GB file
32K 71.9 GB · 128K 130 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
54.6 GB61.7 GB file
32K 54.7 GB · 128K 55.9 GB
Q3_K_M
Mistral Small 4 119B 2603
59.7 GB54.6 GB file
32K 77.8 GB · 128K 136 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
60.7 GB61.7 GB file
32K 60.9 GB · 128K 62.0 GB
Q4_0
Mistral Small 4 119B 2603
61.2 GB67.7 GB file
32K 79.3 GB · 128K 137 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
62.3 GB71.0 GB file
32K 62.5 GB · 128K 63.6 GB
Q4_K_M
Mistral Small 4 119B 2603
73.2 GB72.6 GB file
32K 91.3 GB · 128K 149 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
74.7 GB82.5 GB file
32K 74.8 GB · 128K 75.9 GB
Q5_K_M
Mistral Small 4 119B 2603
86.6 GB85.0 GB file
32K 105 GB · 128K 163 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
88.6 GB107.3 GB file
32K 88.7 GB · 128K 89.9 GB
Q6_K
Mistral Small 4 119B 2603
100 GB102.8 GB file
32K 118 GB · 128K 176 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
102 GB114.8 GB file
32K 103 GB · 128K 104 GB
Q8_0
Mistral Small 4 119B 2603
121 GB126.5 GB file
32K 139 GB · 128K 197 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
124 GB128.5 GB file
32K 124 GB · 128K 125 GB
20 more quants
IQ2_XXS
Mistral Small 4 119B 2603
34.3 GB33.7 GB file
32K 52.5 GB · 128K 110 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
34.5 GB~34.0 GB file
32K 34.7 GB · 128K 35.8 GB
IQ2_XS
Mistral Small 4 119B 2603
37.3 GB37.0 GB file
32K 55.5 GB · 128K 113 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
37.6 GB52.0 GB file
32K 37.8 GB · 128K 38.9 GB
IQ2_S
Mistral Small 4 119B 2603
38.8 GB38.1 GB file
32K 56.9 GB · 128K 115 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
39.1 GB52.1 GB file
32K 39.3 GB · 128K 40.4 GB
IQ2_M
Mistral Small 4 119B 2603
41.8 GB41.6 GB file
32K 59.9 GB · 128K 118 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
42.2 GB52.7 GB file
32K 42.4 GB · 128K 43.5 GB
IQ3_XXS
Mistral Small 4 119B 2603
47.8 GB49.9 GB file
32K 65.9 GB · 128K 124 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
48.4 GB56.6 GB file
32K 48.6 GB · 128K 49.7 GB
Q2_K_S
Mistral Small 4 119B 2603
49.3 GB40.4 GB file
32K 67.4 GB · 128K 125 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
not listed
IQ3_XS
Mistral Small 4 119B 2603
50.8 GB51.8 GB file
32K 68.9 GB · 128K 127 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
51.5 GB64.5 GB file
32K 51.7 GB · 128K 52.8 GB
IQ3_S
Mistral Small 4 119B 2603
52.3 GB44.4 GB file
32K 70.4 GB · 128K 128 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
53.0 GB56.6 GB file
32K 53.2 GB · 128K 54.3 GB
IQ3_M
Mistral Small 4 119B 2603
55.2 GB57.0 GB file
32K 73.4 GB · 128K 131 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
56.1 GB66.3 GB file
32K 56.3 GB · 128K 57.4 GB
Q3_K_L
Mistral Small 4 119B 2603
62.7 GB56.9 GB file
32K 80.8 GB · 128K 139 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
63.8 GB66.4 GB file
32K 64.0 GB · 128K 65.1 GB
IQ4_XS
Mistral Small 4 119B 2603
65.7 GB63.8 GB file
32K 83.8 GB · 128K 142 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
66.9 GB64.5 GB file
32K 67.1 GB · 128K 68.2 GB
IQ4_NL
Mistral Small 4 119B 2603
68.7 GB67.5 GB file
32K 86.8 GB · 128K 145 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
70.0 GB64.5 GB file
32K 70.2 GB · 128K 71.3 GB
Q4_1
Mistral Small 4 119B 2603
68.7 GB74.5 GB file
32K 86.8 GB · 128K 145 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
70.0 GB76.6 GB file
32K 70.2 GB · 128K 71.3 GB
Q4_K_S
Mistral Small 4 119B 2603
68.7 GB69.9 GB file
32K 86.8 GB · 128K 145 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
70.0 GB79.0 GB file
32K 70.2 GB · 128K 71.3 GB
Q4_K_L
Mistral Small 4 119B 2603
74.6 GB73.0 GB file
32K 92.8 GB · 128K 151 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
76.2 GB87.4 GB file
32K 76.4 GB · 128K 77.5 GB
Q5_0
Mistral Small 4 119B 2603
76.1 GB81.9 GB file
32K 94.3 GB · 128K 152 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
not listed
Q5_1
Mistral Small 4 119B 2603
83.6 GB89.3 GB file
32K 102 GB · 128K 160 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
not listed
Q5_K_S
Mistral Small 4 119B 2603
83.6 GB82.2 GB file
32K 102 GB · 128K 160 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
85.5 GB89.7 GB file
32K 85.7 GB · 128K 86.8 GB
Q5_K_L
Mistral Small 4 119B 2603
88.1 GB85.4 GB file
32K 106 GB · 128K 164 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
90.1 GB96.9 GB file
32K 90.3 GB · 128K 91.4 GB
BF16
Mistral Small 4 119B 2603
240 GB238.0 GB file
32K 258 GB · 128K 316 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
248 GB241.5 GB file
32K 248 GB · 128K 249 GB
Mistral Small 4 119B 2603
Ollama · Q4_K_M
ollama run hf.co/bartowski/mistralai_Mistral-Small-4-119B-2603-GGUF:Q4_K_MNVIDIA Nemotron 3 Super 120B A12B BF16
Ollama · Q4_K_M
ollama run hf.co/unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF:Q4_K_M| Spec | Mistral Small 4 119B 2603 | NVIDIA Nemotron 3 Super 120B A12B BF16 |
|---|---|---|
| Publisher | Mistral AI | NVIDIA |
| Parameters | 119.4B | 123.6B |
| Active parameters | 7.1B per token | 13B per token |
| Architecture | Mistral3ForConditionalGeneration | NemotronHForCausalLM |
| Context | 1M tokens | 256K tokens |
| Modalities | Chat, Function-calling | Chat, Function-calling |
| License | Apache 2.0 | Other |
| Released | Jan 2026 | Mar 2026 |
Frequently Asked Questions
Which is better, Mistral Small 4 119B 2603 or NVIDIA Nemotron 3 Super 120B A12B BF16?
Mistral Small 4 119B 2603 and NVIDIA Nemotron 3 Super 120B A12B BF16 match in llmrun Score, with values of 96.4 versus 95.8; neither fits 24 GB. Choose Mistral Small 4 119B 2603 for longer context window and more permissive license.
Which needs less VRAM, Mistral Small 4 119B 2603 or NVIDIA Nemotron 3 Super 120B A12B BF16?
At Q4_K_M, Mistral Small 4 119B 2603 requires 73.2 GB while NVIDIA Nemotron 3 Super 120B A12B BF16 needs 74.7 GB, making Mistral Small 4 119B 2603 the easier model to run on your local setup.
Can I run Mistral Small 4 119B 2603 or NVIDIA Nemotron 3 Super 120B A12B BF16 on a 16 GB GPU?
Mistral Small 4 119B 2603 does not fit (smallest quant needs 42.8 GB); NVIDIA Nemotron 3 Super 120B A12B BF16 does not fit (smallest quant needs 34.5 GB).
Which has a longer context window, Mistral Small 4 119B 2603 or NVIDIA Nemotron 3 Super 120B A12B BF16?
Mistral Small 4 119B 2603 supports 1,048,576 tokens and NVIDIA Nemotron 3 Super 120B A12B BF16 supports 262,144 tokens.