NVIDIA · Blackwell

Best AI Models for NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96 GB)

Runs everything up to 120B MoE well.

96 GB GDDR71792 GB/s439 TFLOPS FP16300 WBlackwell 2025

300 W variant of the 96 GB RTX PRO 6000 — lower clocks than the 600 W edition, but two fit inside a 600 W budget for multi-GPU rigs.

What LLMs can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run?

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
3	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
3	Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 213 t/s	213 tok/s	Q4_K_M · 22.0 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
3	Qwen3.5 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Math Score	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s		Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s		Q4_K_M · 17.9 GB
3	Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 213 t/s	213 tok/s		Q4_K_M · 22.0 GB
4	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	overall	Q4_K_M · 21.7 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s		Q4_K_M · 19.3 GB

#	Model	Speed ↓	Quant · VRAM
1	Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 357 t/s	357 tok/s	Q4_K_M · 3.4 GB
2	GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 282 t/s	282 tok/s	Q4_K_M · 13.1 GB
3	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
4	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB
5	Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 227 t/s	227 tok/s	Q4_K_M · 19.4 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
3	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	JEV 27B VLautotrust Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB

See all 391 models on the RTX PRO 6000 Blackwell Max-Q Workstation Edition →Best quant that fits · speeds estimated on this card

About the RTX PRO 6000 Blackwell Max-Q Workstation Edition

The RTX PRO 6000 Blackwell Max-Q Workstation Edition runs everything up to 120B MoE well. Blackwell generation, released 2025.

GenerationBlackwellreleased 2025

RTX PRO 6000 Blackwell Max-Q Workstation Edition strengths and weaknesses

Strengths

Runs 120B MoE models: GPT OSS 120B at 202 tok/s in 70.8 GB
Room for long context: Llama 3.3 70B Instruct at Q4 uses 51.3 GB, leaving 44.7 GB free
Reads long prompts fast: A 4K-token prompt on Qwen3.8 27B starts answering in 1.2 s
FP8 and NVFP4 run natively: Blackwell takes FP8 and NVFP4 checkpoints in vLLM as published

RTX PRO 6000 Blackwell Max-Q Workstation Edition tokens per second by model size

Output speed depends on memory bandwidth (1792 GB/s).

9BQwen3.5 9B · Q4_K_M · 6.6 GB
183tok/s
14BQwen3 14B · Q4_K_M · 11.9 GB
123tok/s
27–31BQwen3.8 27B · Q4_K_M · 17.9 GB
66.9tok/s
35B MoEQwen3.6 35B A3B · Q4_K_M · 22.0 GB
213tok/s
70BLlama 3.3 70B Instruct · Q4_K_M · 51.3 GB
25.0tok/s
120B MoEGPT OSS 120B · Q4_K_M · 70.8 GB
202tok/s

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 1270 models on the RTX PRO 6000 Blackwell Max-Q Workstation Edition

Featured only

Best quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition — ranked by Score, recency and Fit
Model	Quant	VRAM	Speed	Context	Fit
Gemma 2 2B IT2.6BChat Q4_K_M·552.0 t/s	Q4_K_M	2.6 GB3%	552.0 t/s	8K	S100, Runs great
Txgemma 2B Predict2.6BChat Q4_K_M·673.3 t/s	Q4_K_M	3.6 GB4%	673.3 t/s	—	S100, Runs great
TildeOpen 30B30.7BChat Q4_K_M·60.6 t/s	Q4_K_M	22.7 GB24%	60.6 t/s	66K	A84, Runs well
Covenant 72B Chat72.7BChat Q4_K_M·26.1 t/s	Q4_K_M	46.6 GB49%	26.1 t/s	8K	A67, Runs well
Valuoty Industry Plc 4B4.4BChat Q4_K_M·371.0 t/s	Q4_K_M	4.5 GB5%	371.0 t/s	262K	S100, Runs great
Tiny GPT2LMHeadModel412008Chat Q4_K_M·116480.0 t/s	Q4_K_M	0.0 GB0%	116480.0 t/s	1K	S100, Runs great
Qwen3 1.7B Abliterated1.7BChat Q4_K_M·1040.0 t/s	Q4_K_M	2.8 GB3%	1040.0 t/s	—	S100, Runs great
CHADROCK3.6 35B UNCENSORED MTP STRIX LEAN35BChat BF16·15.1 t/s	BF16	80.9 GB84%	15.1 t/s	—	B49, Decent
Qwen Marketing8.2BChatReasoning BF16·64.6 t/s	BF16	20.6 GB21%	64.6 t/s	—	A84, Runs well
Yi 1.5 9B Chat8.8BChat Q4_K_M·200.8 t/s	Q4_K_M	6 GB6%	200.8 t/s	4K	S100, Runs great
Qwen3 VL 235B A22B Thinking235.7BVisionFunctions IQ3_XXS·78.2 t/s	IQ3_XXS	93.2 GB97%	78.2 t/s	262K	B61, Decent
C4ai Command R7b 12 20248.0BChatFunctions Q4_K_M·219.8 t/s	Q4_K_M	7.9 GB8%	219.8 t/s	—	S100, Runs great
FastVLM 7B7.8BChat BF16·73.0 t/s	BF16	16.8 GB17%	73.0 t/s	33K	S86, Runs great
Venice Uncensored23.6BChat Q4_K_M·78.4 t/s	Q4_K_M	17.8 GB19%	78.4 t/s	33K	S87, Runs great
NVIDIA Nemotron Labs 3 Puzzle 75B A9B BF1675.4BChatFunctions Q4_K_M·129.2 t/s	Q4_K_M	54.5 GB57%	129.2 t/s	262K	S95, Runs great

Rent NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition in the cloud

Hourly rate on demand for one RTX PRO 6000 Blackwell Max-Q Workstation Edition.

Vast.aiMarketplace
from$1.50/hr
Deploy

Buying one ($8,565) costs as much as ~5,700 hours of rental, about 24 months at 8 hours a day.

Cost per million tokens

Output-token cost on an RTX PRO 6000 Blackwell Max-Q Workstation Edition rented at $1.50/hr, one request at a time. Batch several users on the same card and the cost per token drops several-fold.

Model	Quant	Speed	Per 1M output
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16	Q4_K_M	244 tok/s	$1.71$0.010 input
GLM 4.7 Flash	Q4_K_M	196 tok/s	$2.12$0.019 input
Qwen3.8 27B	Q4_K_M	67 tok/s	$6.22$0.12 input
Muse Glimmer 30B	Q4_K_M	64 tok/s	$6.55$0.13 input
Gemma 4 31B IT	Q4_K_M	57 tok/s	$7.29$0.13 input

RTX PRO 6000 Blackwell Max-Q Workstation Edition specs, power and PSU

Specs

Architecture: Blackwell
VRAM: 96 GB GDDR7
Memory bandwidth: 1792.0 GB/s
FP16 (dense): 438.90 TFLOPS
CUDA cores: 24,064
Tensor cores: 752
Compute capability: 12.0
TDP: 300 W
Released: 2025-04-01
MSRP: $8,565

RTX PRO 6000 Blackwell Max-Q Workstation Edition FAQ

What is the largest model the RTX PRO 6000 Blackwell Max-Q Workstation Edition can run?

Mistral Medium 3.5 128B (127.7B) is the largest at 4-bit or better: at Q4_K_M it uses 82.8 GB of 96 GB, and runs at about 15.0 tok/s.

Can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run Qwen3.8 27B?

Yes. Qwen3.8 27B fits at Q4_K_M, using 17.9 GB of 96 GB, and it is the best model that runs well on this card.

How many tokens per second does the RTX PRO 6000 Blackwell Max-Q Workstation Edition give?

About 66.9 tok/s on Qwen3.8 27B at Q4_K_M, with the first token after 1.2 s on a 4K-token prompt.

What power supply does the RTX PRO 6000 Blackwell Max-Q Workstation Edition need?

Plan a 600 W PSU (2× the 300 W TDP).

Is 96 GB enough for coding and agents?

Yes for coding: Qwen3.8 27B, the best of the 14 coding models that fit, runs at about 67 tok/s.

Best coding LLMs 48 GB VRAM GPUs with 96 GB or more RTX 5090 RTX 4090