llmrun

Mistral Small 4 119B 2603 vs GPT OSS 120B

Mistral Small 4 119B 2603 and GPT OSS 120B match in llmrun Score, with values of 96.4 versus 97.5; neither fits 24 GB.

119.4B · 7.1B active · 1M context · Apache 2.0 · Jan 2026

ChatFunctions

116.8B · 5.8B active · 128K context · Apache 2.0 · Aug 2025

ChatFunctions

Which should you choose?

Choose Mistral Small 4 119B 2603 if you want…

  • Longer context window

    1M vs 128K tokens

  • Newer release

    Jan 2026 vs Aug 2025

Choose GPT OSS 120B if you want…

  • Ahead on the benchmarks

    3 of 3 shared boards

On your hardware

Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.

8 GB

RTX 4060 · 8 GB tier

Mistral Small 4 119B 2603

Doesn't fit

smallest quant needs 42.8 GB

GPT OSS 120B

Doesn't fit

smallest quant needs 40.2 GB

12 GB

RTX 3060 12GB · 12 GB tier

Mistral Small 4 119B 2603

Doesn't fit

smallest quant needs 42.8 GB

GPT OSS 120B

Doesn't fit

smallest quant needs 40.2 GB

16 GB

RTX 5060 Ti 16GB · 16 GB tier

Mistral Small 4 119B 2603

Doesn't fit

smallest quant needs 42.8 GB

GPT OSS 120B

Doesn't fit

smallest quant needs 40.2 GB

24 GBreference

RTX 4090 · 24 GB tier

Mistral Small 4 119B 2603

Doesn't fit

smallest quant needs 42.8 GB

GPT OSS 120B

Doesn't fit

smallest quant needs 40.2 GB

32 GB

RTX 5090 · 32 GB tier

Mistral Small 4 119B 2603

Doesn't fit

smallest quant needs 42.8 GB

GPT OSS 120B

Doesn't fit

smallest quant needs 40.2 GB

48 GB

RTX A6000 · 48 GB tier

Mistral Small 4 119B 2603

IQ2_S · ~152 tok/s

47.3 GB · up to 16K

GPT OSS 120B

IQ2_M · ~169 tok/s

40.2 GB · up to 128K

Mac 32 GB

Mac Mini M4 · Macs

Mistral Small 4 119B 2603

Doesn't fit

smallest quant needs 42.8 GB

GPT OSS 120B

Doesn't fit

smallest quant needs 40.2 GB

Mac 64 GB

Mac Studio M4 Max · Macs

Mistral Small 4 119B 2603

IQ3_XS · ~66 tok/s

59.2 GB · up to 16K

GPT OSS 120B

Q4_0 · ~68 tok/s

59.1 GB · up to 64Kbetter quant

Mac 128 GB

Mac Studio M4 Max · Macs

Mistral Small 4 119B 2603

Q4_K_M · ~54 tok/s

81.6 GB · up to 64K

GPT OSS 120B

Q4_K_M · ~61 tok/s

70.8 GB · up to 128Kfaster

Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).

llmrun Score

with its 90% range · bars share one scale

Overall

Mistral Small 4 119B 2603

96.489–104

GPT OSS 120B

97.595–100

Coding

Mistral Small 4 119B 2603

no data

GPT OSS 120B

97.593–102

Agents

Mistral Small 4 119B 2603

no data

GPT OSS 120B

81.574–89

Science

Mistral Small 4 119B 2603

no data

GPT OSS 120B

103.496–111

Reasoning

Mistral Small 4 119B 2603

95.788–104

GPT OSS 120B

95.989–103

Mistral Small 4 119B 2603 · #61 of 100 open models · #28 of 60 that fit ≤96 GB

GPT OSS 120B · #58 of 100 open models · #25 of 60 that fit ≤96 GB

Benchmarks

3 shared boards: Mistral Small 4 119B 2603 leads 0, GPT OSS 120B leads 3 · Benchmarks imported Oct 2026

Mistral Small 4 119B 2603

497.6#32/43 open

Lab-reportedEpoch AI · Mar 2026

GPT OSS 120B

575.6#29/43 open

Lab-reportedEpoch AI · Aug 2025

Mistral Small 4 119B 2603

70.9%#32/68 open

Lab-reportedEpoch AI · Mar 2026

GPT OSS 120B

76.3%#27/68 open

Lab-reportedEpoch AI · Aug 2025

Mistral Small 4 119B 2603

20.6%#33/54 open

Lab-reportedEpoch AI · Mar 2026

GPT OSS 120B

22.1%#32/54 open

Lab-reportedEpoch AI · Aug 2025

18 more boards (other shared and single-model boards)

VRAM by quantization

Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.

Q2_K

Mistral Small 4 119B 2603

52.3 GB42.1 GB file

32K 70.4 GB · 128K 128 GB

GPT OSS 120B

50.1 GB62.6 GB file

32K 50.8 GB · 128K 53.4 GB

Q3_K_S

Mistral Small 4 119B 2603

53.8 GB52.0 GB file

32K 71.9 GB · 128K 130 GB

GPT OSS 120B

51.5 GB62.6 GB file

32K 52.3 GB · 128K 54.8 GB

Q3_K_M

Mistral Small 4 119B 2603

59.7 GB54.6 GB file

32K 77.8 GB · 128K 136 GB

GPT OSS 120B

57.4 GB62.6 GB file

32K 58.1 GB · 128K 60.7 GB

Q4_0

Mistral Small 4 119B 2603

61.2 GB67.7 GB file

32K 79.3 GB · 128K 137 GB

GPT OSS 120B

58.8 GB62.6 GB file

32K 59.6 GB · 128K 62.1 GB

Q4_K_M

Mistral Small 4 119B 2603

73.2 GB72.6 GB file

32K 91.3 GB · 128K 149 GB

GPT OSS 120B

70.5 GB62.8 GB file

32K 71.3 GB · 128K 73.8 GB

Q5_K_M

Mistral Small 4 119B 2603

86.6 GB85.0 GB file

32K 105 GB · 128K 163 GB

GPT OSS 120B

83.7 GB62.9 GB file

32K 84.4 GB · 128K 86.9 GB

Q6_K

Mistral Small 4 119B 2603

100 GB102.8 GB file

32K 118 GB · 128K 176 GB

GPT OSS 120B

96.8 GB63.3 GB file

32K 97.5 GB · 128K 100 GB

Q8_0

Mistral Small 4 119B 2603

121 GB126.5 GB file

32K 139 GB · 128K 197 GB

GPT OSS 120B

117 GB~116.8 GB file

32K 118 GB · 128K 121 GB

20 more quants

IQ2_XXS

Mistral Small 4 119B 2603

34.3 GB33.7 GB file

32K 52.5 GB · 128K 110 GB

GPT OSS 120B

not listed

IQ2_XS

Mistral Small 4 119B 2603

37.3 GB37.0 GB file

32K 55.5 GB · 128K 113 GB

GPT OSS 120B

not listed

IQ2_S

Mistral Small 4 119B 2603

38.8 GB38.1 GB file

32K 56.9 GB · 128K 115 GB

GPT OSS 120B

not listed

IQ2_M

Mistral Small 4 119B 2603

41.8 GB41.6 GB file

32K 59.9 GB · 128K 118 GB

GPT OSS 120B

39.8 GB~39.4 GB file

32K 40.6 GB · 128K 43.1 GB

IQ3_XXS

Mistral Small 4 119B 2603

47.8 GB49.9 GB file

32K 65.9 GB · 128K 124 GB

GPT OSS 120B

not listed

Q2_K_S

Mistral Small 4 119B 2603

49.3 GB40.4 GB file

32K 67.4 GB · 128K 125 GB

GPT OSS 120B

not listed

IQ3_XS

Mistral Small 4 119B 2603

50.8 GB51.8 GB file

32K 68.9 GB · 128K 127 GB

GPT OSS 120B

not listed

IQ3_S

Mistral Small 4 119B 2603

52.3 GB44.4 GB file

32K 70.4 GB · 128K 128 GB

GPT OSS 120B

not listed

IQ3_M

Mistral Small 4 119B 2603

55.2 GB57.0 GB file

32K 73.4 GB · 128K 131 GB

GPT OSS 120B

53.0 GB62.7 GB file

32K 53.7 GB · 128K 56.3 GB

Q3_K_L

Mistral Small 4 119B 2603

62.7 GB56.9 GB file

32K 80.8 GB · 128K 139 GB

GPT OSS 120B

60.3 GB62.6 GB file

32K 61.0 GB · 128K 63.6 GB

IQ4_XS

Mistral Small 4 119B 2603

65.7 GB63.8 GB file

32K 83.8 GB · 128K 142 GB

GPT OSS 120B

63.2 GB62.7 GB file

32K 64.0 GB · 128K 66.5 GB

IQ4_NL

Mistral Small 4 119B 2603

68.7 GB67.5 GB file

32K 86.8 GB · 128K 145 GB

GPT OSS 120B

66.1 GB62.7 GB file

32K 66.9 GB · 128K 69.4 GB

Q4_1

Mistral Small 4 119B 2603

68.7 GB74.5 GB file

32K 86.8 GB · 128K 145 GB

GPT OSS 120B

66.1 GB62.7 GB file

32K 66.9 GB · 128K 69.4 GB

Q4_K_S

Mistral Small 4 119B 2603

68.7 GB69.9 GB file

32K 86.8 GB · 128K 145 GB

GPT OSS 120B

66.1 GB62.8 GB file

32K 66.9 GB · 128K 69.4 GB

Q4_K_L

Mistral Small 4 119B 2603

74.6 GB73.0 GB file

32K 92.8 GB · 128K 151 GB

GPT OSS 120B

72.0 GB63.1 GB file

32K 72.7 GB · 128K 75.3 GB

Q5_0

Mistral Small 4 119B 2603

76.1 GB81.9 GB file

32K 94.3 GB · 128K 152 GB

GPT OSS 120B

not listed

Q5_1

Mistral Small 4 119B 2603

83.6 GB89.3 GB file

32K 102 GB · 128K 160 GB

GPT OSS 120B

not listed

Q5_K_S

Mistral Small 4 119B 2603

83.6 GB82.2 GB file

32K 102 GB · 128K 160 GB

GPT OSS 120B

80.7 GB62.9 GB file

32K 81.5 GB · 128K 84.0 GB

Q5_K_L

Mistral Small 4 119B 2603

88.1 GB85.4 GB file

32K 106 GB · 128K 164 GB

GPT OSS 120B

not listed

BF16

Mistral Small 4 119B 2603

240 GB238.0 GB file

32K 258 GB · 128K 316 GB

GPT OSS 120B

234 GB~233.7 GB file

32K 235 GB · 128K 237 GB

How to run each

Specifications

Specifications of Mistral Small 4 119B 2603 and GPT OSS 120B
SpecMistral Small 4 119B 2603GPT OSS 120B
PublisherMistral AIOpenAI
Parameters119.4B116.8B
Active parameters7.1B per token5.8B per token
ArchitectureMistral3ForConditionalGenerationGptOssForCausalLM
Context1M tokens128K tokens
ModalitiesChat, Function-callingChat, Function-calling
LicenseApache 2.0Apache 2.0
ReleasedJan 2026Aug 2025

Frequently Asked Questions

Which is better, Mistral Small 4 119B 2603 or GPT OSS 120B?

Mistral Small 4 119B 2603 and GPT OSS 120B match in llmrun Score, with values of 96.4 versus 97.5; neither fits 24 GB. Choose Mistral Small 4 119B 2603 for longer context window and newer release; choose GPT OSS 120B for ahead on the benchmarks.

Which needs less VRAM, Mistral Small 4 119B 2603 or GPT OSS 120B?

At Q4_K_M, Mistral Small 4 119B 2603 requires 73.2 GB while GPT OSS 120B needs 70.5 GB, making GPT OSS 120B the easier model to run on your local setup.

Can I run Mistral Small 4 119B 2603 or GPT OSS 120B on a 16 GB GPU?

Mistral Small 4 119B 2603 does not fit (smallest quant needs 42.8 GB); GPT OSS 120B does not fit (smallest quant needs 40.2 GB).

Which has a longer context window, Mistral Small 4 119B 2603 or GPT OSS 120B?

Mistral Small 4 119B 2603 supports 1,048,576 tokens and GPT OSS 120B supports 131,072 tokens.

Mistral Small 4 119B 2603 vs GPT OSS 120B — VRAM & GPU Comparison | llmrun