Can NVIDIA GeForce RTX 5090 run Qwen3 Coder 480B A35B Instruct?

No — Qwen3 Coder 480B A35B Instruct requires at least 144.6 GB at IQ2_XS, which exceeds the NVIDIA GeForce RTX 5090's 32 GB of VRAM.

What's the best quantization for Qwen3 Coder 480B A35B Instruct?

For Qwen3 Coder 480B A35B Instruct, Q4_K_M (288.6 GB) offers the best balance of quality and VRAM usage. Q5_K_S (330.7 GB) provides better quality if you have the VRAM. The smallest option is IQ2_XS at 144.6 GB.

Can I run Qwen3 Coder 480B A35B Instruct on a Mac?

Qwen3 Coder 480B A35B Instruct requires at least 144.6 GB at IQ2_XS, which exceeds the unified memory of most consumer Macs. You would need a Mac Studio or Mac Pro with a high-memory configuration.

Can I run Qwen3 Coder 480B A35B Instruct locally?

Yes — Qwen3 Coder 480B A35B Instruct can run locally on consumer hardware. At Q4_K_M quantization it needs 288.6 GB of VRAM. Popular tools include Ollama, LM Studio, and llama.cpp.

What's the download size of Qwen3 Coder 480B A35B Instruct?

At Q4_K_M, the download is about 288.09 GB. The full-precision Q8_0 version is 480.15 GB. The smallest option (IQ2_XS) is 144.05 GB.

Alibaba·Qwen·Qwen3MoeForCausalLM

Qwen3 Coder 480B A35B Instruct — Hardware Requirements & GPU Compatibility

ChatCode

Qwen3 Coder 480B A35B Instruct is Alibaba's largest code-specialized model, a massive 480.2-billion-parameter mixture-of-experts system with roughly 35 billion parameters active per token. This is the most powerful open-weight coding model in the Qwen3 family, designed for professional-grade code generation, analysis, and software engineering tasks. Running this model locally is a serious undertaking that requires multi-GPU server-class hardware with several hundred gigabytes of combined VRAM. For users with access to such infrastructure, it offers exceptional code quality and understanding that rivals leading proprietary coding assistants, all while keeping data and computation entirely under local control.

76.6K downloads 1.3K likesAug 2025262K context

Specifications

Publisher: Alibaba
Family: Qwen
Parameters: 480.2B
Architecture: Qwen3MoeForCausalLM
Context Length: 262,144 tokens
Vocabulary Size: 151,936
Release Date: 2025-08-21
License: Apache 2.0

Get Started

HuggingFace

Qwen/Qwen3-Coder-480B-A35B-Instruct

How Much VRAM Does Qwen3 Coder 480B A35B Instruct Need?

Select a quantization to see compatible GPUs below.

Quantization	Bits	VRAM	+ Context	File Size	Quality
IQ2_XS	2.40	144.6 GB	177.6 GB	144.05 GB	Importance-weighted 2-bit, extra small
IQ2_S	2.50	150.6 GB	183.6 GB	150.05 GB	Importance-weighted 2-bit, small
IQ3_XXS	3.10	186.6 GB	219.7 GB	186.06 GB	Importance-weighted 3-bit
IQ3_XS	3.30	198.6 GB	231.7 GB	198.06 GB	Importance-weighted 3-bit, extra small
Q2_K	3.40	204.6 GB	237.7 GB	204.07 GB	2-bit quantization with K-quant improvements
Q3_K_S	3.50	210.6 GB	243.7 GB	210.07 GB	3-bit small quantization
IQ3_M	3.60	216.6 GB	249.7 GB	216.07 GB	Importance-weighted 3-bit, medium
Q3_K_M	3.90	234.6 GB	267.7 GB	234.08 GB	3-bit medium quantization
Q4_0	4.00	240.6 GB	273.7 GB	240.08 GB	4-bit legacy quantization
Q3_K_L	4.10	246.6 GB	279.7 GB	246.08 GB	3-bit large quantization
IQ4_XS	4.30	258.6 GB	291.7 GB	258.08 GB	Importance-weighted 4-bit, compact
Q4_1	4.50	270.6 GB	303.7 GB	270.09 GB	4-bit legacy quantization with offset
Q4_K_S	4.50	270.6 GB	303.7 GB	270.09 GB	4-bit small quantization
IQ4_NL	4.50	270.6 GB	303.7 GB	270.09 GB	Importance-weighted 4-bit, non-linear
Q4_K_M	4.80	288.6 GB	321.7 GB	288.09 GB	4-bit medium quantization — most popular sweet spot
Q5_K_S	5.50	330.7 GB	363.7 GB	330.11 GB	5-bit small quantization
Q5_K_M	5.70	342.7 GB	375.7 GB	342.11 GB	5-bit medium quantization — good quality/size tradeoff
Q6_K	6.60	396.7 GB	429.7 GB	396.13 GB	6-bit quantization, very good quality
Q8_0	8.00	480.7 GB	513.7 GB	480.15 GB	8-bit quantization, near-lossless

Which GPUs Can Run Qwen3 Coder 480B A35B Instruct?

Q4_K_M · 288.6 GB

Show professional

Qwen3 Coder 480B A35B Instruct (Q4_K_M) requires 288.6 GB of VRAM to load the model weights. For comfortable inference with headroom for KV cache and system overhead, 376+ GB is recommended. Using the full 262K context window can add up to 33.0 GB, bringing total usage to 321.7 GB. No single GPU has enough memory — multi-GPU or cluster setups are needed.

Which Devices Can Run Qwen3 Coder 480B A35B Instruct?

Q4_K_M · 288.6 GB

2 devices with unified memory can run Qwen3 Coder 480B A35B Instruct, including NVIDIA DGX H100, NVIDIA DGX A100 640GB.

Runs great

— Plenty of headroom

NVIDIA DGX H100~60 tok/s NVIDIA DGX A100 640GB~37 tok/s

Related Models

Derivatives (7)

Qwen Qwen3 Coder 480B A35B Instruct GGUF Qwen.Qwen3 Coder 480B A35B Instruct GGUF Qwen3 Coder 480B A35B Instruct 1M GGUF Qwen3 Coder 480B A35B Instruct GGUF Qwen3 Coder 480B A35B Instruct GGUF Qwen3 Coder 480B A35B Instruct GGUF Qwen3 Coder 480B A35B Instruct NVFP4

Frequently Asked Questions

How much VRAM does Qwen3 Coder 480B A35B Instruct need?: Qwen3 Coder 480B A35B Instruct requires 288.6 GB of VRAM at Q4_K_M, or 480.7 GB at Q8_0. Full 262K context adds up to 33.0 GB (321.7 GB total).
VRAM = Weights + KV Cache + Overhead
Weights = 480.2B × 4.8 bits ÷ 8 = 288.1 GB
KV Cache + Overhead ≈ 0.5 GB (at 2K context + ~0.3 GB framework)
KV Cache + Overhead ≈ 33.6 GB (at full 262K context)
VRAM usage by quantization
Q4_K_M
288.6 GB
Q4_K_M + full context
321.7 GB
Learn more about VRAM estimation →
Can NVIDIA GeForce RTX 5090 run Qwen3 Coder 480B A35B Instruct?: No — Qwen3 Coder 480B A35B Instruct requires at least 144.6 GB at IQ2_XS, which exceeds the NVIDIA GeForce RTX 5090's 32 GB of VRAM.
What's the best quantization for Qwen3 Coder 480B A35B Instruct?: For Qwen3 Coder 480B A35B Instruct, Q4_K_M (288.6 GB) offers the best balance of quality and VRAM usage. Q5_K_S (330.7 GB) provides better quality if you have the VRAM. The smallest option is IQ2_XS at 144.6 GB.
VRAM requirement by quantization
IQ2_XS
144.6 GB~57%
Q3_K_S
210.6 GB~77%
Q3_K_L
246.6 GB~86%
Q4_K_M ★
288.6 GB~89%
Q5_K_S
330.7 GB~92%
Q8_0
480.7 GB~99%
★ Recommended — best balance of quality and VRAM usage.
Learn more about quantization →
Can I run Qwen3 Coder 480B A35B Instruct on a Mac?: Qwen3 Coder 480B A35B Instruct requires at least 144.6 GB at IQ2_XS, which exceeds the unified memory of most consumer Macs. You would need a Mac Studio or Mac Pro with a high-memory configuration.
Can I run Qwen3 Coder 480B A35B Instruct locally?: Yes — Qwen3 Coder 480B A35B Instruct can run locally on consumer hardware. At Q4_K_M quantization it needs 288.6 GB of VRAM. Popular tools include Ollama, LM Studio, and llama.cpp.
What's the download size of Qwen3 Coder 480B A35B Instruct?: At Q4_K_M, the download is about 288.09 GB. The full-precision Q8_0 version is 480.15 GB. The smallest option (IQ2_XS) is 144.05 GB.