llmrun
XiaomiMiMoV2ForCausalLM

MiMo V2.5 Pro — Hardware Requirements & GPU Compatibility

ChatFunctionsCode

MiMo V2.5 Pro is a 1023.2B-parameter open language model from Xiaomi. It supports a context window of up to 1,048,576 tokens. At Q4_K_M it needs about 614.47 GB of VRAM — see which GPUs and Macs can run it below.

1023.2B params · MoE44B active1049K contextMIT19.6K downloads753 likes4.1K quant downloads

MiMo V2.5 Pro runs on a multi-GPU server

Q4_K_M needs ~616 GB · about 5× H200 SXM 141 GB · or Mac Studio (M3 Ultra, 512GB) at Q3_K_M (~20 tok/s)

Macs from512 GB Q3_K_M · ~20 tok/s

Score 116.4#17 of 100 open#14 of 96 that fit ≤640 GBMIT

Not set up for it?

Reference GPU · RTX 4090 24 GB

Estimates, ±20% · how we estimate

Run MiMo V2.5 Pro

One recommended way. Every other method, OS and quant is in the step-by-step guide.

Recommended

vLLM on a multi-GPU server
tensor + pipeline parallel · needs vLLM on every node
$vllm serve XiaomiMiMo/MiMo-V2.5-Pro --max-model-len 16384 --tensor-parallel-size 8

Size the nodes from the table above

Download: UD-Q4_K_M/MiMo-V2.5-Pro-UD-Q4_K_M-00001-of-00015.gguf629.61 GB + 14 partsunsloth

install, other ways

Other ways

each opens step-by-step

Run in cloud

Rent 5× H200 SXM · Q4_K_M

Estimated hourly price
~$17.95/hr
est., whole server
GPUs
5 GPUs
705 GB of VRAM

How Much VRAM Does MiMo V2.5 Pro Need?

Select a quantization level; the listed hardware adheres to it.

QuantizationVRAM+32KRuns on
281.9 GB285.2 GB2-bit · i-quant extreme compression — Importance-weighted 2-bit, extreme compression — significant quality lossRuns on Instinct MI350X 288 GB
320.3 GB323.6 GB2-bit · i-quant small — Importance-weighted 2-bit, smallRuns on 5× H100 SXM 80 GB
435.4 GB438.7 GB2-bit · K-quant — 2-bit quantization with K-quant improvementsRuns on 7× H100 SXM 80 GB
499.4 GB502.7 GB3-bit medium — 3-bit medium quantizationRuns on 7× H100 SXM 80 GB
614.5 GB617.8 GB4-bit medium — 4-bit medium quantization — most popular sweet spotRuns on 5× H200 SXM 141 GB
729.6 GB732.9 GB5-bit medium — 5-bit medium quantization — good quality/size tradeoffRuns on 6× H200 SXM 141 GB
844.7 GB848 GB6-bit, very good — 6-bit quantization, very good qualityRuns on 7× H200 SXM 141 GB
1023.8 GB1027.1 GB8-bit, near-lossless — 8-bit quantization, near-losslessRuns on 6× B200 192 GB

Selected Q4_K_M

4-bit medium quantization

616.0GBat 16K context

Weights
614.0 GB
KV cache
1.8 GB
Overhead
0.3 GB

Server-class: ~616 GB at 16K context · about 5× H200 SXM 141 GB

Which Hardware Can Run MiMo V2.5 Pro?

Q4_K_M · 614.5 GB

MiMo V2.5 Pro (Q4_K_M) requires 614.5 GB of VRAM to load the model weights. For comfortable inference with headroom for KV cache and system overhead, 799+ GB is recommended. Using the full 1049K context window can add up to 112.5 GB, bringing total usage to 727.0 GB. No consumer GPU has enough memory.

Needs server-class hardware

MiMo V2.5 Pro runs on a multi-GPU server · Q4_K_M needs ~616 GB

Hardware that runs this model
HardwareQuantMemorySpeedContextHardware page
Mac 512 GB · Mac Studio (M3 Ultra, 512GB)Q3_K_M500.9 GB~20 tok/s64K ctxMac Studio →Q3_K_M · 500.9 GB · ~20 tok/s · 64K ctx
8× H100 SXM 80 GB · 640 GBIQ4_XS552.1 GB—128K ctxH100 SXM →IQ4_XS · 552.1 GB · 128K ctx
5× H200 SXM 141 GB · 705 GBQ4_K_M616 GB—128K ctxH200 SXM →Q4_K_M · 616 GB · 128K ctx
4× B200 192 GB · 768 GBQ4_K_M616 GB—512K ctxB200 →Q4_K_M · 616 GB · 512K ctx

Also: NVIDIA DGX A100 640GB · NVIDIA DGX H100

≤ 640 GB tier →

By VRAM tier · typical GPUs and Macs at Q4_K_M

Consumer GPUs (up to 32 GB) and Macs up to 256 GB: too small for this model (needs ≥ 283.5 GB)8 GB tier →12 GB tier →16 GB tier →24 GB tier →Macs →

How good is MiMo V2.5 Pro?

The llmrun Score merges 6 public benchmark boards into a single figure, where 100 represents the average for open models.

Score vs VRAM in the ≤640 GB tier

  • MiMo V2.5 Pro
  • Other models
  • Best Score for its VRAM

#14 of 96 that fit ≤640 GB

Each dot is a model at the best quant that fits ≤640 GB. The line joins the models with the best Score for their VRAM; a dot below it is beaten by a model that needs no more memory.

Full ≤640 GB ranking →

Benchmarks

The 6 boards that weigh most in the llmrun Score, of 8 with a result for this model; badges show who ran the test.

  • LMArena Text

    LMArena · Oct 2026Arena

    1467.3

    #7/187 open

    Arena
  • LMArena WebDev

    LMArena · Oct 2026Arena

    1481.3

    #18/52 open

    Arena
  • SciCode

    Epoch AILab-reported

    50.2%

    #10/66 open

    Lab-reported
  • ALE-Bench

    Epoch AILab-reported

    899.8

    #14/43 open

    Lab-reported
  • ProofBench

    Epoch AILab-reported

    22.0%

    #11/26 open

    Lab-reported
  • CritPt

    Epoch AILab-reported

    4.0%

    #18/66 open

    Lab-reported

In the ≤640 GB class

96 models fit ≤640 GB

Same Score, only models that fit ≤640 GB at their best quant: this model's peers by memory need.

  1. #1

    133.4

    614.1 GB

  2. #2

    131.9

    186.5 GB

  3. #3

    130.1

    453.8 GB

  4. #4

    129.5

    458.4 GB

  5. #5

    127.6

    183.0 GB

  6. #6

    125.3

    551.9 GB

Alternatives to MiMo V2.5 Pro

Official models with an llmrun Score, each answering one question; sizes are each model's default quant (usually Q4_K_M) with a 16K-token context.

Similar models

10
ModelScoreVRAMWhy it is similar
DeepSeek V4 Pro 0813DeepSeek129.2990.8 GBsimilar score
Muse Spark Open 816B A42BMeta125.3551.9 GBsimilar score
GLM 5.2Z.ai122.9453.8 GBsimilar score
Qwen3.8 27BAlibaba122.117.9 GBsimilar score
Kimi K2.6Moonshot AI120.9617.6 GBsimilar score
Inkling SmallThinking Machines119.6162.7 GBsimilar score
GLM 5.1Z.ai117.8454.1 GBsimilar score
DeepSeek V4 ProDeepSeek116.5959.8 GBsimilar score
MiniMax M3MiniMax112.5258 GBsimilar score
GLM 5Z.ai111.6454.1 GBsimilar score

Specifications

Publisher
Xiaomi
Parameters
1023.2B
Active parameters
43.9B per token
Architecture
MiMoV2ForCausalLM
Context Length
1,048,576 tokens
Vocabulary Size
152,576
Release Date
2026-04-27
License
MIT

Frequently Asked Questions

How much VRAM does MiMo V2.5 Pro need?

MiMo V2.5 Pro requires 614.5 GB of VRAM at Q4_K_M, or 2047.0 GB at BF16. Full 1049K context adds up to 112.5 GB (727.0 GB total).

VRAM = Weights + KV Cache + Overhead

Weights = 1023.2B × 4.8 bits ÷ 8 = 613.9 GB

KV Cache + Overhead ≈ 0.6 GB (at 2K context + ~0.3 GB framework)

Fit ratings and hardware model lists check this model with room for a 16K-token context, which needs a little more memory.

KV Cache + Overhead ≈ 113.1 GB (at full 1049K context)

VRAM usage by quantization

614.5 GB
727.0 GB

Learn more about VRAM estimation →

Can NVIDIA GeForce RTX 5090 run MiMo V2.5 Pro?

No — MiMo V2.5 Pro requires at least 281.9 GB at IQ2_XXS, which exceeds the NVIDIA GeForce RTX 5090's 32 GB of VRAM.

What's the best quantization for MiMo V2.5 Pro?

For MiMo V2.5 Pro, Q4_K_M (614.5 GB) offers the best balance of quality and VRAM usage. Q5_K_S (704 GB) provides better quality if you have the VRAM. The smallest option is IQ2_XXS at 281.9 GB.

VRAM requirement by quantization

IQ2_XXS
281.9 GB
Q2_K
435.4 GB
IQ4_NL
576.1 GB
Q4_K_M ★
614.5 GB
Q5_K_S
704.0 GB
BF16
2047.0 GB

★ Recommended — best balance of quality and VRAM usage.

Learn more about quantization →

Can I run MiMo V2.5 Pro on a Mac?

Yes, but only at lower quantizations. The smallest Mac that can run MiMo V2.5 Pro is Mac Studio (M3 Ultra, 512GB) at Q3_K_M; 1 of the 146 Macs we list can run it at some quantization. For Q4_K_M (614.5 GB) you need a Mac with more unified memory.

Can I run MiMo V2.5 Pro locally?

Yes — MiMo V2.5 Pro can run locally on consumer hardware. Popular tools include Ollama, LM Studio, and llama.cpp.

What's the download size of MiMo V2.5 Pro?

At Q4_K_M, the download is about 613.95 GB. The full-precision BF16 version is 2046.49 GB. The smallest option (IQ2_XXS) is 281.39 GB.

Which GPUs can run MiMo V2.5 Pro?

No single consumer GPU has enough VRAM to run MiMo V2.5 Pro at Q4_K_M (614.5 GB). Multi-GPU or professional hardware is required.

Which devices can run MiMo V2.5 Pro?

5 GB).