Mistral Large Instruct 2407 vs Inkling Small

Inkling Small leads llmrun Score 119.6 to 81.7; neither fits 24 GB.

Run Inkling Small in the cloud →

Model A · Mistral AI

Mistral Large Instruct 2407

81.7llmrun Score

122.6B · Other · Jul 2024

ChatFunctions

Model B · Thinking Machines

Inkling Small

119.6llmrun Score

266.0B · 1.7B active · Apache 2.0 · Jul 2026

VisionChat

Which should you choose?

Choose Mistral Large Instruct 2407 if you want…

Fits a Mac 128 GB
Q4_K_M · 86.4 GB; Inkling Small needs 76.3 GB at its smallest quant
Lighter on memory
80.9 vs 160.2 GB at Q4_K_M
Also does function-calling
Inkling Small doesn't list it

Choose Inkling Small if you want…

Higher llmrun Score
119.6 vs 81.7
Stronger at reasoning
122.6 vs 85.6
Also does vision
Mistral Large Instruct 2407 doesn't list it
More permissive license
Apache 2.0 vs Other
Newer release
Jul 2026 vs Jul 2024

On your hardware

Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.

MemoryMistral Large Instruct 2407Inkling Small

8 GB

RTX 4060 · 8 GB tier

Mistral Large Instruct 2407

Doesn't fit

smallest quant needs 42.6 GB

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

12 GB

RTX 3060 12GB · 12 GB tier

Mistral Large Instruct 2407

Doesn't fit

smallest quant needs 42.6 GB

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

16 GB

RTX 5060 Ti 16GB · 16 GB tier

Mistral Large Instruct 2407

Doesn't fit

smallest quant needs 42.6 GB

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

24 GBreference

RTX 4090 · 24 GB tier

Mistral Large Instruct 2407

Doesn't fit

smallest quant needs 42.6 GB

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

32 GB

RTX 5090 · 32 GB tier

Mistral Large Instruct 2407

Doesn't fit

smallest quant needs 42.6 GB

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

48 GB

RTX A6000 · 48 GB tier

Mistral Large Instruct 2407

IQ2_S · ~12 tok/s

47.7 GB · up to 16Kfits

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

Mac 32 GB

Mac Mini M4 · Macs

Mistral Large Instruct 2407

Doesn't fit

smallest quant needs 42.6 GB

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

Mac 64 GB

Mac Studio M4 Max · Macs

Mistral Large Instruct 2407

Q2_K_S · ~7 tok/s

59.5 GB · up to 16Kfits

Inkling Small

Doesn't fit

smallest quant needs 76.3 GB

Mac 128 GB

Mac Studio M4 Max · Macs

Mistral Large Instruct 2407

Q4_K_M · ~5 tok/s

86.4 GB · up to 32Kmore headroom

Inkling Small

Q2_K · ~97 tok/s

116.2 GB · up to 32K

Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).

llmrun Score

with its 90% range · bars share one scale

Mistral Large Instruct 2407 Inkling Small

Overall

Mistral Large Instruct 2407

81.777–86

Inkling Small

119.6117–122

Math

Mistral Large Instruct 2407

no data

Inkling Small

117.1113–121

Science

Mistral Large Instruct 2407

no data

Inkling Small

118.2107–129

Reasoning

Mistral Large Instruct 2407

85.677–94

Inkling Small

122.6119–126

Mistral Large Instruct 2407 · #87 of 106 open models · #44 of 62 that fit ≤96 GB

Inkling Small · #16 of 106 open models · #6 of 82 that fit ≤192 GB

Benchmarks

2 shared boards: Mistral Large Instruct 2407 leads 0, Inkling Small leads 2 · Benchmarks imported Nov 2026

BoardMistral Large Instruct 2407Inkling Small

GPQA Diamond

Mistral Large Instruct 2407

49.0%#58/100 open

IndependentEpoch AI · Jul 2024

Inkling Small

88.5%#15/100 open

IndependentEpoch AI · Jul 2026

AIME 2024/2025

Mistral Large Instruct 2407

8.5%#61/88 open

IndependentEpoch AI · Jul 2024

Inkling Small

90.0%#16/88 open

IndependentEpoch AI · Jul 2026

17 more boards (other shared and single-model boards)

LMArena Text

Mistral Large Instruct 2407

1314.4#99/188 open

ArenaLMArena · Oct 2026

Inkling Small

1405.5#47/188 open

ArenaLMArena · Oct 2026

Only Mistral Large Instruct 2407 (6)

Only Inkling Small (10)

VRAM by quantization

Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.

QuantMistral Large Instruct 2407Inkling Small

Q2_K

Mistral Large Instruct 2407

57.3 GB45.2 GB file

32K 69.1 GB · 128K 107 GB

Inkling Small

114 GB~113.0 GB file

32K 119 GB · 128K 136 GB

Q3_K_S

Mistral Large Instruct 2407

59.0 GB52.8 GB file

32K 70.8 GB · 128K 109 GB

Inkling Small

not listed

Q3_K_M

Mistral Large Instruct 2407

65.8 GB59.1 GB file

32K 77.6 GB · 128K 115 GB

Inkling Small

130 GB119.4 GB file

32K 136 GB · 128K 153 GB

Q4_0

Mistral Large Instruct 2407

67.4 GB69.1 GB file

32K 79.3 GB · 128K 117 GB

Inkling Small

not listed

Q4_K_M

Mistral Large Instruct 2407

80.9 GB73.2 GB file

32K 92.7 GB · 128K 131 GB

Inkling Small

160 GB162.5 GB file

32K 166 GB · 128K 182 GB

Q5_K_M

Mistral Large Instruct 2407

96.1 GB86.5 GB file

32K 108 GB · 128K 146 GB

Inkling Small

190 GB196.1 GB file

32K 195 GB · 128K 212 GB

Q6_K

Mistral Large Instruct 2407

111 GB100.6 GB file

32K 123 GB · 128K 161 GB

Inkling Small

220 GB218.9 GB file

32K 225 GB · 128K 242 GB

Q8_0

Mistral Large Instruct 2407

135 GB130.3 GB file

32K 147 GB · 128K 184 GB

Inkling Small

267 GB280.3 GB file

32K 272 GB · 128K 289 GB

16 more quants

IQ2_XXS

Mistral Large Instruct 2407

37.1 GB32.4 GB file

32K 48.9 GB · 128K 86.7 GB

Inkling Small

73.8 GB82.3 GB file

32K 79.1 GB · 128K 96.0 GB

IQ2_XS

Mistral Large Instruct 2407

40.5 GB36.1 GB file

32K 52.3 GB · 128K 90.1 GB

Inkling Small

not listed

IQ2_S

Mistral Large Instruct 2407

42.2 GB38.4 GB file

32K 54.0 GB · 128K 91.8 GB

Inkling Small

not listed

IQ2_M

Mistral Large Instruct 2407

45.5 GB41.6 GB file

32K 57.3 GB · 128K 95.1 GB

Inkling Small

90.4 GB82.4 GB file

32K 95.7 GB · 128K 113 GB

IQ3_XXS

Mistral Large Instruct 2407

52.3 GB47.0 GB file

32K 64.1 GB · 128K 102 GB

Inkling Small

104 GB97.9 GB file

32K 109 GB · 128K 126 GB

Q2_K_S

Mistral Large Instruct 2407

54.0 GB41.6 GB file

32K 65.8 GB · 128K 104 GB

Inkling Small

not listed

IQ3_XS

Mistral Large Instruct 2407

55.6 GB50.1 GB file

32K 67.4 GB · 128K 105 GB

Inkling Small

not listed

IQ3_S

Mistral Large Instruct 2407

not listed

Inkling Small

114 GB107.5 GB file

32K 119 GB · 128K 136 GB

IQ3_M

Mistral Large Instruct 2407

60.7 GB55.3 GB file

32K 72.5 GB · 128K 110 GB

Inkling Small

not listed

Q3_K_L

Mistral Large Instruct 2407

69.1 GB64.6 GB file

32K 80.9 GB · 128K 119 GB

Inkling Small

not listed

IQ4_XS

Mistral Large Instruct 2407

72.5 GB65.4 GB file

32K 84.3 GB · 128K 122 GB

Inkling Small

144 GB127.4 GB file

32K 149 GB · 128K 166 GB

IQ4_NL

Mistral Large Instruct 2407

not listed

Inkling Small

150 GB130.1 GB file

32K 156 GB · 128K 172 GB

Q4_K_S

Mistral Large Instruct 2407

75.9 GB69.6 GB file

32K 87.7 GB · 128K 125 GB

Inkling Small

150 GB152.3 GB file

32K 156 GB · 128K 172 GB

Q5_0

Mistral Large Instruct 2407

84.3 GB84.4 GB file

32K 96.1 GB · 128K 134 GB

Inkling Small

not listed

Q5_K_S

Mistral Large Instruct 2407

92.7 GB84.4 GB file

32K 105 GB · 128K 142 GB

Inkling Small

184 GB184.2 GB file

32K 189 GB · 128K 206 GB

BF16

Mistral Large Instruct 2407

270 GB~245.2 GB file

32K 282 GB · 128K 319 GB

Inkling Small

533 GB527.4 GB file

32K 538 GB · 128K 555 GB

How to run each

Mistral Large Instruct 2407

Ollama · Q4_K_M

$ollama run hf.co/MaziyarPanahi/Mistral-Large-Instruct-2407-GGUF:Q4_K_M

All ways to run Mistral Large Instruct 2407 →

Inkling Small

Ollama · Q4_K_M

$ollama run hf.co/unsloth/Inkling-Small-GGUF:Q4_K_M

All ways to run Inkling Small →

Specifications

Specifications of Mistral Large Instruct 2407 and Inkling Small
Spec	Mistral Large Instruct 2407	Inkling Small
Publisher	Mistral AI	Thinking Machines
Parameters	122.6B	266.0B
Active parameters	—	1.7B per token
Architecture	—	InklingForConditionalGeneration
Modalities	Chat, Function-calling	Vision, Chat
License	Other	Apache 2.0
Released	Jul 2024	Jul 2026

Frequently Asked Questions

Which is better, Mistral Large Instruct 2407 or Inkling Small?

Inkling Small leads llmrun Score 119.6 to 81.7; neither fits 24 GB. Choose Mistral Large Instruct 2407 for fits a Mac 128 GB and lighter on memory; choose Inkling Small for higher llmrun Score and stronger at reasoning.

Which needs less VRAM, Mistral Large Instruct 2407 or Inkling Small?

At Q4_K_M, Mistral Large Instruct 2407 requires 80.9 GB while Inkling Small needs 160.2 GB, making Mistral Large Instruct 2407 the easier model to run on your local setup.

Can I run Mistral Large Instruct 2407 or Inkling Small on a 16 GB GPU?

Mistral Large Instruct 2407 does not fit (smallest quant needs 42.6 GB); Inkling Small does not fit (smallest quant needs 76.3 GB).