NVIDIA Nemotron 3 Super 120B A12B BF16 vs GPT OSS 120B
NVIDIA Nemotron 3 Super 120B A12B BF16 and GPT OSS 120B match in llmrun Score, with values of 95.8 versus 97.6; neither fits 24 GB.
Model A · NVIDIA
NVIDIA Nemotron 3 Super 120B A12B BF16123.6B · 13B active · 256K context · Other · Mar 2026
Model B · OpenAI
GPT OSS 120B116.8B · 5.8B active · 128K context · Apache 2.0 · Aug 2025
Choose NVIDIA Nemotron 3 Super 120B A12B BF16 if you want…
Longer context window
256K vs 128K tokens
Newer release
Mar 2026 vs Aug 2025
Choose GPT OSS 120B if you want…
More permissive license
Apache 2.0 vs Other
On your hardware
Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.
8 GB
RTX 4060 · 8 GB tier
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
GPT OSS 120B
Doesn't fit
smallest quant needs 40.2 GB
12 GB
RTX 3060 12GB · 12 GB tier
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
GPT OSS 120B
Doesn't fit
smallest quant needs 40.2 GB
16 GB
RTX 5060 Ti 16GB · 16 GB tier
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
GPT OSS 120B
Doesn't fit
smallest quant needs 40.2 GB
24 GBreference
RTX 4090 · 24 GB tier
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
GPT OSS 120B
Doesn't fit
smallest quant needs 40.2 GB
32 GB
RTX 5090 · 32 GB tier
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
GPT OSS 120B
Doesn't fit
smallest quant needs 40.2 GB
48 GB
RTX A6000 · 48 GB tier
NVIDIA Nemotron 3 Super 120B A12B BF16
IQ2_M · ~73 tok/s
42.2 GB · up to 256K
GPT OSS 120B
IQ2_M · ~169 tok/s
40.2 GB · up to 128Kfaster
Mac 32 GB
Mac Mini M4 · Macs
NVIDIA Nemotron 3 Super 120B A12B BF16
Doesn't fit
smallest quant needs 34.5 GB
GPT OSS 120B
Doesn't fit
smallest quant needs 40.2 GB
Mac 64 GB
Mac Studio M4 Max · Macs
NVIDIA Nemotron 3 Super 120B A12B BF16
IQ3_M · ~30 tok/s
56.1 GB · up to 256K
GPT OSS 120B
Q4_0 · ~68 tok/s
59.1 GB · up to 64Kbetter quant
Mac 128 GB
Mac Studio M4 Max · Macs
NVIDIA Nemotron 3 Super 120B A12B BF16
Q4_K_M · ~26 tok/s
74.7 GB · up to 256K
GPT OSS 120B
Q4_K_M · ~61 tok/s
70.8 GB · up to 128Kfaster
Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).
Overall
NVIDIA Nemotron 3 Super 120B A12B BF16
GPT OSS 120B
Coding
NVIDIA Nemotron 3 Super 120B A12B BF16
GPT OSS 120B
Agents
NVIDIA Nemotron 3 Super 120B A12B BF16
no data
GPT OSS 120B
Science
NVIDIA Nemotron 3 Super 120B A12B BF16
GPT OSS 120B
Reasoning
NVIDIA Nemotron 3 Super 120B A12B BF16
no data
GPT OSS 120B
NVIDIA Nemotron 3 Super 120B A12B BF16 · #60 of 92 open models · #29 of 54 that fit ≤96 GB
GPT OSS 120B · #54 of 92 open models · #23 of 54 that fit ≤96 GB
Benchmarks
4 shared boards: NVIDIA Nemotron 3 Super 120B A12B BF16 leads 2, GPT OSS 120B leads 1 · Benchmarks imported Oct 2026
NVIDIA Nemotron 3 Super 120B A12B BF16
1360.3#68/186 open
ArenaLMArena · Oct 2026
GPT OSS 120B
1351.8#74/186 open
ArenaLMArena · Oct 2026
NVIDIA Nemotron 3 Super 120B A12B BF16
36.0%#38/65 open
Lab-reportedEpoch AI · Mar 2026
GPT OSS 120B
36.0%#39/65 open
Lab-reportedEpoch AI · Aug 2025
NVIDIA Nemotron 3 Super 120B A12B BF16
38.0%#28/46 open
IndependentEpoch AI · Mar 2026
GPT OSS 120B
48.2%#11/46 open
IndependentEpoch AI · Aug 2025
NVIDIA Nemotron 3 Super 120B A12B BF16
3.1%#23/65 open
Lab-reportedEpoch AI · Mar 2026
GPT OSS 120B
1.1%#31/65 open
Lab-reportedEpoch AI · Aug 2025
17 more boards (other shared and single-model boards)
NVIDIA Nemotron 3 Super 120B A12B BF16
213.9#41/42 open
Lab-reportedEpoch AI · Mar 2026
GPT OSS 120B
575.6#28/42 open
Lab-reportedEpoch AI · Aug 2025
Only GPT OSS 120B (16)
- SWE-bench Verified26.0%
- GPQA Diamond75.8%
- AIME 2024/202588.9%
- Terminal-Bench18.7%
- MMLU-Pro80.8%
- Aider Polyglot41.8%
- SWE-bench Bash Only26.0%
- SimpleBench22.1%
- Chess Puzzles20.0%
- DTBench76.3%
- LMCA22.1%
- APEX-Agents4.4%
- Fiction.LiveBench44.4%
- Mystery Game Puzzles2.0%
- Vending-Bench 2-21.5
- Surface Evolver Bench25.0%
VRAM by quantization
Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.
Q2_K
NVIDIA Nemotron 3 Super 120B A12B BF16
53.0 GB54.8 GB file
32K 53.2 GB · 128K 54.3 GB
GPT OSS 120B
50.1 GB62.6 GB file
32K 50.8 GB · 128K 53.4 GB
Q3_K_S
NVIDIA Nemotron 3 Super 120B A12B BF16
54.6 GB61.7 GB file
32K 54.7 GB · 128K 55.9 GB
GPT OSS 120B
51.5 GB62.6 GB file
32K 52.3 GB · 128K 54.8 GB
Q3_K_M
NVIDIA Nemotron 3 Super 120B A12B BF16
60.7 GB61.7 GB file
32K 60.9 GB · 128K 62.0 GB
GPT OSS 120B
57.4 GB62.6 GB file
32K 58.1 GB · 128K 60.7 GB
Q4_0
NVIDIA Nemotron 3 Super 120B A12B BF16
62.3 GB71.0 GB file
32K 62.5 GB · 128K 63.6 GB
GPT OSS 120B
58.8 GB62.6 GB file
32K 59.6 GB · 128K 62.1 GB
Q4_K_M
NVIDIA Nemotron 3 Super 120B A12B BF16
74.7 GB82.5 GB file
32K 74.8 GB · 128K 75.9 GB
GPT OSS 120B
70.5 GB62.8 GB file
32K 71.3 GB · 128K 73.8 GB
Q5_K_M
NVIDIA Nemotron 3 Super 120B A12B BF16
88.6 GB107.3 GB file
32K 88.7 GB · 128K 89.9 GB
GPT OSS 120B
83.7 GB62.9 GB file
32K 84.4 GB · 128K 86.9 GB
Q6_K
NVIDIA Nemotron 3 Super 120B A12B BF16
102 GB114.8 GB file
32K 103 GB · 128K 104 GB
GPT OSS 120B
96.8 GB63.3 GB file
32K 97.5 GB · 128K 100 GB
Q8_0
NVIDIA Nemotron 3 Super 120B A12B BF16
124 GB128.5 GB file
32K 124 GB · 128K 125 GB
GPT OSS 120B
117 GB~116.8 GB file
32K 118 GB · 128K 121 GB
17 more quants
IQ2_XXS
NVIDIA Nemotron 3 Super 120B A12B BF16
34.5 GB~34.0 GB file
32K 34.7 GB · 128K 35.8 GB
GPT OSS 120B
not listed
IQ2_XS
NVIDIA Nemotron 3 Super 120B A12B BF16
37.6 GB52.0 GB file
32K 37.8 GB · 128K 38.9 GB
GPT OSS 120B
not listed
IQ2_S
NVIDIA Nemotron 3 Super 120B A12B BF16
39.1 GB52.1 GB file
32K 39.3 GB · 128K 40.4 GB
GPT OSS 120B
not listed
IQ2_M
NVIDIA Nemotron 3 Super 120B A12B BF16
42.2 GB52.7 GB file
32K 42.4 GB · 128K 43.5 GB
GPT OSS 120B
39.8 GB~39.4 GB file
32K 40.6 GB · 128K 43.1 GB
IQ3_XXS
NVIDIA Nemotron 3 Super 120B A12B BF16
48.4 GB56.6 GB file
32K 48.6 GB · 128K 49.7 GB
GPT OSS 120B
not listed
IQ3_XS
NVIDIA Nemotron 3 Super 120B A12B BF16
51.5 GB64.5 GB file
32K 51.7 GB · 128K 52.8 GB
GPT OSS 120B
not listed
IQ3_S
NVIDIA Nemotron 3 Super 120B A12B BF16
53.0 GB56.6 GB file
32K 53.2 GB · 128K 54.3 GB
GPT OSS 120B
not listed
IQ3_M
NVIDIA Nemotron 3 Super 120B A12B BF16
56.1 GB66.3 GB file
32K 56.3 GB · 128K 57.4 GB
GPT OSS 120B
53.0 GB62.7 GB file
32K 53.7 GB · 128K 56.3 GB
Q3_K_L
NVIDIA Nemotron 3 Super 120B A12B BF16
63.8 GB66.4 GB file
32K 64.0 GB · 128K 65.1 GB
GPT OSS 120B
60.3 GB62.6 GB file
32K 61.0 GB · 128K 63.6 GB
IQ4_XS
NVIDIA Nemotron 3 Super 120B A12B BF16
66.9 GB64.5 GB file
32K 67.1 GB · 128K 68.2 GB
GPT OSS 120B
63.2 GB62.7 GB file
32K 64.0 GB · 128K 66.5 GB
IQ4_NL
NVIDIA Nemotron 3 Super 120B A12B BF16
70.0 GB64.5 GB file
32K 70.2 GB · 128K 71.3 GB
GPT OSS 120B
66.1 GB62.7 GB file
32K 66.9 GB · 128K 69.4 GB
Q4_1
NVIDIA Nemotron 3 Super 120B A12B BF16
70.0 GB76.6 GB file
32K 70.2 GB · 128K 71.3 GB
GPT OSS 120B
66.1 GB62.7 GB file
32K 66.9 GB · 128K 69.4 GB
Q4_K_S
NVIDIA Nemotron 3 Super 120B A12B BF16
70.0 GB79.0 GB file
32K 70.2 GB · 128K 71.3 GB
GPT OSS 120B
66.1 GB62.8 GB file
32K 66.9 GB · 128K 69.4 GB
Q4_K_L
NVIDIA Nemotron 3 Super 120B A12B BF16
76.2 GB87.4 GB file
32K 76.4 GB · 128K 77.5 GB
GPT OSS 120B
72.0 GB63.1 GB file
32K 72.7 GB · 128K 75.3 GB
Q5_K_S
NVIDIA Nemotron 3 Super 120B A12B BF16
85.5 GB89.7 GB file
32K 85.7 GB · 128K 86.8 GB
GPT OSS 120B
80.7 GB62.9 GB file
32K 81.5 GB · 128K 84.0 GB
Q5_K_L
NVIDIA Nemotron 3 Super 120B A12B BF16
90.1 GB96.9 GB file
32K 90.3 GB · 128K 91.4 GB
GPT OSS 120B
not listed
BF16
NVIDIA Nemotron 3 Super 120B A12B BF16
248 GB241.5 GB file
32K 248 GB · 128K 249 GB
GPT OSS 120B
234 GB~233.7 GB file
32K 235 GB · 128K 237 GB
NVIDIA Nemotron 3 Super 120B A12B BF16
Ollama · Q4_K_M
ollama run hf.co/unsloth/NVIDIA-Nemotron-3-Super-120B-A12B-GGUF:Q4_K_MGPT OSS 120B
Ollama · Q4_K_M
ollama run hf.co/unsloth/gpt-oss-120b-GGUF:Q4_K_M| Spec | NVIDIA Nemotron 3 Super 120B A12B BF16 | GPT OSS 120B |
|---|---|---|
| Publisher | NVIDIA | OpenAI |
| Parameters | 123.6B | 116.8B |
| Active parameters | 13B per token | 5.8B per token |
| Architecture | NemotronHForCausalLM | GptOssForCausalLM |
| Context | 256K tokens | 128K tokens |
| Modalities | Chat, Function-calling | Chat, Function-calling |
| License | Other | Apache 2.0 |
| Released | Mar 2026 | Aug 2025 |
Frequently Asked Questions
Which is better, NVIDIA Nemotron 3 Super 120B A12B BF16 or GPT OSS 120B?
NVIDIA Nemotron 3 Super 120B A12B BF16 and GPT OSS 120B match in llmrun Score, with values of 95.8 versus 97.6; neither fits 24 GB. Choose NVIDIA Nemotron 3 Super 120B A12B BF16 for longer context window and newer release; choose GPT OSS 120B for more permissive license.
Which needs less VRAM, NVIDIA Nemotron 3 Super 120B A12B BF16 or GPT OSS 120B?
At Q4_K_M, NVIDIA Nemotron 3 Super 120B A12B BF16 requires 74.7 GB while GPT OSS 120B needs 70.5 GB, making GPT OSS 120B the easier model to run on your local setup.
Can I run NVIDIA Nemotron 3 Super 120B A12B BF16 or GPT OSS 120B on a 16 GB GPU?
NVIDIA Nemotron 3 Super 120B A12B BF16 does not fit (smallest quant needs 34.5 GB); GPT OSS 120B does not fit (smallest quant needs 40.2 GB).
Which has a longer context window, NVIDIA Nemotron 3 Super 120B A12B BF16 or GPT OSS 120B?
NVIDIA Nemotron 3 Super 120B A12B BF16 supports 262,144 tokens and GPT OSS 120B supports 131,072 tokens.