Can NVIDIA GeForce RTX 5090 run GLM 5?

No — GLM 5 requires at least 211.5 GB at IQ2_XXS, which exceeds the NVIDIA GeForce RTX 5090's 32 GB of VRAM.

What's the best quantization for GLM 5?

For GLM 5, Q4_K_M (456.5 GB) offers the best balance of quality and VRAM usage. Q5_K_S (522.5 GB) provides better quality if you have the VRAM. The smallest option is IQ2_XXS at 211.5 GB.

Can I run GLM 5 on a Mac?

GLM 5 requires at least 211.5 GB at IQ2_XXS, which exceeds the unified memory of most consumer Macs. You would need a Mac Studio or Mac Pro with a high-memory configuration.

Can I run GLM 5 locally?

Yes — GLM 5 can run locally on consumer hardware. At Q4_K_M quantization it needs 456.5 GB of VRAM. Popular tools include Ollama, LM Studio, and llama.cpp.

What's the download size of GLM 5?

At Q4_K_M, the download is about 452.32 GB. The full-precision Q8_0 version is 753.86 GB. The smallest option (IQ2_XXS) is 207.31 GB.

zai-org·GLM·GlmMoeDsaForCausalLM

GLM 5 — Hardware Requirements & GPU Compatibility

Chat

GLM 5 is Zhipu AI's flagship foundation model, a massive mixture-of-experts architecture with nearly 754 billion total parameters. It represents one of the largest open-weight models available, offering state-of-the-art performance across reasoning, coding, math, and multilingual tasks in both Chinese and English. Running GLM 5 locally requires enterprise-grade multi-GPU infrastructure, but for users with access to such hardware, it provides a locally-hosted alternative to the largest proprietary models.

199.0K downloads 1.8K likesMar 2026203K context

Specifications

Publisher: zai-org
Family: GLM
Parameters: 753.9B
Architecture: GlmMoeDsaForCausalLM
Context Length: 202,752 tokens
Vocabulary Size: 154,880
Release Date: 2026-03-13
License: MIT

Get Started

HuggingFace

zai-org/GLM-5

How Much VRAM Does GLM 5 Need?

Select a quantization to see compatible GPUs below.

Quantization	Bits	VRAM	+ Context	File Size	Quality
IQ2_XXS	2.20	211.5 GB	596.3 GB	207.31 GB	Importance-weighted 2-bit, extreme compression — significant quality loss
IQ2_M	2.70	258.7 GB	643.4 GB	254.43 GB	Importance-weighted 2-bit, medium
IQ3_XXS	3.10	296.4 GB	681.1 GB	292.12 GB	Importance-weighted 3-bit
Q2_K	3.40	324.6 GB	709.4 GB	320.39 GB	2-bit quantization with K-quant improvements
Q3_K_S	3.50	334.0 GB	718.8 GB	329.82 GB	3-bit small quantization
Q3_K_M	3.90	371.7 GB	756.5 GB	367.51 GB	3-bit medium quantization
Q4_0	4.00	381.2 GB	765.9 GB	376.93 GB	4-bit legacy quantization
IQ4_XS	4.30	409.4 GB	794.2 GB	405.20 GB	Importance-weighted 4-bit, compact
Q4_1	4.50	428.3 GB	813.0 GB	424.05 GB	4-bit legacy quantization with offset
Q4_K_S	4.50	428.3 GB	813.0 GB	424.05 GB	4-bit small quantization
IQ4_NL	4.50	428.3 GB	813.0 GB	424.05 GB	Importance-weighted 4-bit, non-linear
Q4_K_M	4.80	456.5 GB	841.3 GB	452.32 GB	4-bit medium quantization — most popular sweet spot
Q5_K_S	5.50	522.5 GB	907.2 GB	518.28 GB	5-bit small quantization
Q5_K_M	5.70	541.4 GB	926.1 GB	537.13 GB	5-bit medium quantization — good quality/size tradeoff
Q6_K	6.60	626.2 GB	1010.9 GB	621.94 GB	6-bit quantization, very good quality
Q8_0	8.00	758.1 GB	1142.8 GB	753.86 GB	8-bit quantization, near-lossless

Which GPUs Can Run GLM 5?

Q4_K_M · 456.5 GB

Show professional

GLM 5 (Q4_K_M) requires 456.5 GB of VRAM to load the model weights. For comfortable inference with headroom for KV cache and system overhead, 594+ GB is recommended. Using the full 203K context window can add up to 384.7 GB, bringing total usage to 841.3 GB. No single GPU has enough memory — multi-GPU or cluster setups are needed.

Which Devices Can Run GLM 5?

Q4_K_M · 456.5 GB

2 devices with unified memory can run GLM 5, including NVIDIA DGX H100.

Decent

— Enough memory, may be tight

NVIDIA DGX H100~38 tok/s NVIDIA DGX A100 640GB~23 tok/s

Related Models

Derivatives (1)

GLM 5 Abliterated

Frequently Asked Questions

How much VRAM does GLM 5 need?: GLM 5 requires 456.5 GB of VRAM at Q4_K_M, or 758.1 GB at Q8_0. Full 203K context adds up to 384.7 GB (841.3 GB total).
VRAM = Weights + KV Cache + Overhead
Weights = 753.9B × 4.8 bits ÷ 8 = 452.3 GB
KV Cache + Overhead ≈ 4.2 GB (at 2K context + ~0.3 GB framework)
KV Cache + Overhead ≈ 389 GB (at full 203K context)
VRAM usage by quantization
Q4_K_M
456.5 GB
Q4_K_M + full context
841.3 GB
Learn more about VRAM estimation →
Can NVIDIA GeForce RTX 5090 run GLM 5?: No — GLM 5 requires at least 211.5 GB at IQ2_XXS, which exceeds the NVIDIA GeForce RTX 5090's 32 GB of VRAM.
What's the best quantization for GLM 5?: For GLM 5, Q4_K_M (456.5 GB) offers the best balance of quality and VRAM usage. Q5_K_S (522.5 GB) provides better quality if you have the VRAM. The smallest option is IQ2_XXS at 211.5 GB.
VRAM requirement by quantization
IQ2_XXS
211.5 GB~53%
Q3_K_S
334.0 GB~77%
Q4_1
428.3 GB~88%
Q4_K_M ★
456.5 GB~89%
Q5_K_S
522.5 GB~92%
Q8_0
758.1 GB~99%
★ Recommended — best balance of quality and VRAM usage.
Learn more about quantization →
Can I run GLM 5 on a Mac?: GLM 5 requires at least 211.5 GB at IQ2_XXS, which exceeds the unified memory of most consumer Macs. You would need a Mac Studio or Mac Pro with a high-memory configuration.
Can I run GLM 5 locally?: Yes — GLM 5 can run locally on consumer hardware. At Q4_K_M quantization it needs 456.5 GB of VRAM. Popular tools include Ollama, LM Studio, and llama.cpp.
What's the download size of GLM 5?: At Q4_K_M, the download is about 452.32 GB. The full-precision Q8_0 version is 753.86 GB. The smallest option (IQ2_XXS) is 207.31 GB.