NVIDIA · Blackwell

Best AI Models for NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96 GB)

Runs everything up to 120B MoE well.

96 GB GDDR71792 GB/s439 TFLOPS FP16300 WBlackwell 2025

300 W variant of the 96 GB RTX PRO 6000 — lower clocks than the 600 W edition, but two fit inside a 600 W budget for multi-GPU rigs.

What LLMs can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run?

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
3	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
3	Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 213 t/s	213 tok/s	Q4_K_M · 22.0 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
3	Qwen3.5 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Math Score	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s		Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s		Q4_K_M · 17.9 GB
3	Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 213 t/s	213 tok/s		Q4_K_M · 22.0 GB
4	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	overall	Q4_K_M · 21.7 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s		Q4_K_M · 19.3 GB

#	Model	Speed ↓	Quant · VRAM
1	Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 357 t/s	357 tok/s	Q4_K_M · 3.4 GB
2	GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 282 t/s	282 tok/s	Q4_K_M · 13.1 GB
3	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
4	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB
5	Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 227 t/s	227 tok/s	Q4_K_M · 19.4 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
3	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	JEV 27B VLautotrust Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB

See all 391 models on the RTX PRO 6000 Blackwell Max-Q Workstation Edition →Best quant that fits · speeds estimated on this card

About the RTX PRO 6000 Blackwell Max-Q Workstation Edition

The RTX PRO 6000 Blackwell Max-Q Workstation Edition runs everything up to 120B MoE well. Blackwell generation, released 2025.

GenerationBlackwellreleased 2025

RTX PRO 6000 Blackwell Max-Q Workstation Edition strengths and weaknesses

Strengths

Runs 120B MoE models: GPT OSS 120B at 202 tok/s in 70.8 GB
Room for long context: Llama 3.3 70B Instruct at Q4 uses 51.3 GB, leaving 44.7 GB free
Reads long prompts fast: A 4K-token prompt on Qwen3.8 27B starts answering in 1.2 s
FP8 and NVFP4 run natively: Blackwell takes FP8 and NVFP4 checkpoints in vLLM as published

RTX PRO 6000 Blackwell Max-Q Workstation Edition tokens per second by model size

Output speed depends on memory bandwidth (1792 GB/s).

9BQwen3.5 9B · Q4_K_M · 6.6 GB
183tok/s
14BQwen3 14B · Q4_K_M · 11.9 GB
123tok/s
27–31BQwen3.8 27B · Q4_K_M · 17.9 GB
66.9tok/s
35B MoEQwen3.6 35B A3B · Q4_K_M · 22.0 GB
213tok/s
70BLlama 3.3 70B Instruct · Q4_K_M · 51.3 GB
25.0tok/s
120B MoEGPT OSS 120B · Q4_K_M · 70.8 GB
202tok/s

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 1270 models on the RTX PRO 6000 Blackwell Max-Q Workstation Edition

Featured only

Best quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition — ranked by Score, recency and Fit
Model	Quant	VRAM	Speed	Context	Fit
WeVisOne VL 2B2.4BVisionFunctions Q4_K_M·582.4 t/s	Q4_K_M	3.6 GB4%	582.4 t/s	262K	S100, Runs great
LocateAnything 3B3.8BVisionFunctions Q4_K_M·436.3 t/s	Q4_K_M	3.2 GB3%	436.3 t/s	33K	S100, Runs great
JiRackUltra 1B1.8BChatFunctions Q4_K_M·820.3 t/s	Q4_K_M	1.8 GB2%	820.3 t/s	131K	S100, Runs great
MiniCPM V 4.6 Thinking1.3BVisionFunctions Q4_K_M·1030.8 t/s	Q4_K_M	1.5 GB2%	1030.8 t/s	262K	S100, Runs great
DeepSeek R1 0528 Qwen3 8B8.2BChatReasoningFunctions Q4_K_M·211.0 t/s	Q4_K_M	7.6 GB8%	211.0 t/s	131K	S100, Runs great
QwQ 32B32.8BChatReasoningFunctions Q4_K_M·56.8 t/s	Q4_K_M	24.3 GB25%	56.8 t/s	41K	A82, Runs well
JiRackDeltaNet 27B27.3BChatFunctions Q4_K_M·68.0 t/s	Q4_K_M	17.6 GB18%	68.0 t/s	262K	S85, Runs great
Ling 3.0 Tiny7.9BChatFunctions Q4_K_M·471.1 t/s	Q4_K_M	5.5 GB6%	471.1 t/s	131K	S100, Runs great
JiRackUltra 14B14.8BChatFunctions Q4_K_M·121.8 t/s	Q4_K_M	12.4 GB13%	121.8 t/s	131K	S95, Runs great
ALoDLM 8B8.2BChatCodeFunctions Q4_K_M·211.0 t/s	Q4_K_M	7.6 GB8%	211.0 t/s	41K	S100, Runs great
Ornith 1.5 9B OBLITERATED9.7BChatFunctions Q4_K_M·183.1 t/s	Q4_K_M	6.6 GB7%	183.1 t/s	262K	S99, Runs great
Qwen3.5 35B A3B36.0BVision Q4_K_M·213.3 t/s	Q4_K_M	22.0 GB23%	213.3 t/s	262K	S100, Runs great
ZDTaichu5.0 9B9.8BVisionFunctions Q4_K_M·180.3 t/s	Q4_K_M	9.2 GB10%	180.3 t/s	—	S99, Runs great
Granite Switch 4.1 8B8.8BChatFunctions Q4_K_M·196.8 t/s	Q4_K_M	8.4 GB9%	196.8 t/s	131K	S100, Runs great
LensVLM 9B9.4BVisionFunctions Q4_K_M·187.6 t/s	Q4_K_M	6.5 GB7%	187.6 t/s	262K	S99, Runs great

Rent NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition in the cloud

Hourly rate on demand for one RTX PRO 6000 Blackwell Max-Q Workstation Edition.

Vast.aiMarketplace
from$1.54/hr
Deploy

Buying one ($8,565) costs as much as ~5,600 hours of rental, about 23 months at 8 hours a day.

Cost per million tokens

Output-token cost on an RTX PRO 6000 Blackwell Max-Q Workstation Edition rented at $1.54/hr, one request at a time. Batch several users on the same card and the cost per token drops several-fold.

Model	Quant	Speed	Per 1M output
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16	Q4_K_M	244 tok/s	$1.75$0.010 input
GLM 4.7 Flash	Q4_K_M	196 tok/s	$2.18$0.020 input
Qwen3.8 27B	Q4_K_M	67 tok/s	$6.38$0.12 input
Muse Glimmer 30B	Q4_K_M	64 tok/s	$6.72$0.13 input
Gemma 4 31B IT	Q4_K_M	57 tok/s	$7.48$0.14 input

RTX PRO 6000 Blackwell Max-Q Workstation Edition specs, power and PSU

Specs

Architecture: Blackwell
VRAM: 96 GB GDDR7
Memory bandwidth: 1792.0 GB/s
FP16 (dense): 438.90 TFLOPS
CUDA cores: 24,064
Tensor cores: 752
Compute capability: 12.0
TDP: 300 W
Released: 2025-04-01
MSRP: $8,565

RTX PRO 6000 Blackwell Max-Q Workstation Edition FAQ

What is the largest model the RTX PRO 6000 Blackwell Max-Q Workstation Edition can run?

Mistral Medium 3.5 128B (127.7B) is the largest at 4-bit or better: at Q4_K_M it uses 82.8 GB of 96 GB, and runs at about 15.0 tok/s.

Can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run Qwen3.8 27B?

Yes. Qwen3.8 27B fits at Q4_K_M, using 17.9 GB of 96 GB, and it is the best model that runs well on this card.

How many tokens per second does the RTX PRO 6000 Blackwell Max-Q Workstation Edition give?

About 66.9 tok/s on Qwen3.8 27B at Q4_K_M, with the first token after 1.2 s on a 4K-token prompt.

What power supply does the RTX PRO 6000 Blackwell Max-Q Workstation Edition need?

Plan a 600 W PSU (2× the 300 W TDP).

Is 96 GB enough for coding and agents?

Yes for coding: Qwen3.8 27B, the best of the 14 coding models that fit, runs at about 67 tok/s.

Best coding LLMs 48 GB VRAM GPUs with 96 GB or more RTX 5090 RTX 4090