NVIDIA · Blackwell

Best AI Models for NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition (96 GB)

Runs everything up to 120B MoE well.

96 GB GDDR71792 GB/s439 TFLOPS FP16300 WBlackwell 2025

300 W variant of the 96 GB RTX PRO 6000 — lower clocks than the 600 W edition, but two fit inside a 600 W budget for multi-GPU rigs.

What LLMs can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run?

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
3	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
3	Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 213 t/s	213 tok/s	Q4_K_M · 22.0 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
3	Qwen3.5 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB

#	Model	Speed	Math Score	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s		Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s		Q4_K_M · 17.9 GB
3	Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 213 t/s	213 tok/s		Q4_K_M · 22.0 GB
4	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	overall	Q4_K_M · 21.7 GB
5	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s		Q4_K_M · 19.3 GB

#	Model	Speed ↓	Quant · VRAM
1	Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 357 t/s	357 tok/s	Q4_K_M · 3.4 GB
2	GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 282 t/s	282 tok/s	Q4_K_M · 13.1 GB
3	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
4	NVIDIA Nemotron 3.5 Lightning 30B A3B BF16NVIDIA Q4_K_M · 19.3 GB · 244 t/s	244 tok/s	Q4_K_M · 19.3 GB
5	Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 227 t/s	227 tok/s	Q4_K_M · 19.4 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.8 27BAlibabaHow to run → Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
2	Qwen3.6 27BAlibaba Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB
3	Gemma 4 31B ITGoogle Q4_K_M · 21.7 GB · 57.1 t/s	57.1 tok/s	Q4_K_M · 21.7 GB
4	Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 250 t/s	250 tok/s	Q4_K_M · 16.5 GB
5	JEV 27B VLautotrust Q4_K_M · 17.9 GB · 66.9 t/s	66.9 tok/s	Q4_K_M · 17.9 GB

See all 391 models on the RTX PRO 6000 Blackwell Max-Q Workstation Edition →Best quant that fits · speeds estimated on this card

About the RTX PRO 6000 Blackwell Max-Q Workstation Edition

The RTX PRO 6000 Blackwell Max-Q Workstation Edition runs everything up to 120B MoE well. Blackwell generation, released 2025.

GenerationBlackwellreleased 2025

RTX PRO 6000 Blackwell Max-Q Workstation Edition strengths and weaknesses

Strengths

Runs 120B MoE models: GPT OSS 120B at 202 tok/s in 70.8 GB
Room for long context: Llama 3.3 70B Instruct at Q4 uses 51.3 GB, leaving 44.7 GB free
Reads long prompts fast: A 4K-token prompt on Qwen3.8 27B starts answering in 1.2 s
FP8 and NVFP4 run natively: Blackwell takes FP8 and NVFP4 checkpoints in vLLM as published

RTX PRO 6000 Blackwell Max-Q Workstation Edition tokens per second by model size

Output speed depends on memory bandwidth (1792 GB/s).

9BQwen3.5 9B · Q4_K_M · 6.6 GB
183tok/s
14BQwen3 14B · Q4_K_M · 11.9 GB
123tok/s
27–31BQwen3.8 27B · Q4_K_M · 17.9 GB
66.9tok/s
35B MoEQwen3.6 35B A3B · Q4_K_M · 22.0 GB
213tok/s
70BLlama 3.3 70B Instruct · Q4_K_M · 51.3 GB
25.0tok/s
120B MoEGPT OSS 120B · Q4_K_M · 70.8 GB
202tok/s

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 1270 models on the RTX PRO 6000 Blackwell Max-Q Workstation Edition

Featured only

Best quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition — ranked by Score, recency and Fit
Model	Quant	VRAM	Speed	Context	Fit
Goedel Prover v2 32B32.8BChat Q4_K_M·57.4 t/s	Q4_K_M	22.6 GB24%	57.4 t/s	41K	A82, Runs well
OlmOCR 2 7B 10258.3BVision Q4_K_M·216.1 t/s	Q4_K_M	6.2 GB6%	216.1 t/s	128K	S100, Runs great
Tiny GPTNeoXForCausalLM806624Chat Q4_K_M·3882.7 t/s	Q4_K_M	0.3 GB0%	3882.7 t/s	2K	S100, Runs great
Dots.ocr3.0BVision Q4_K_M·534.3 t/s	Q4_K_M	2.6 GB3%	534.3 t/s	131K	S100, Runs great
Tiny MistralForCausalLM 0.2513960Chat Q4_K_M·3882.7 t/s	Q4_K_M	0.5 GB0%	3882.7 t/s	33K	S100, Runs great
Qwen3 4B Base Dapo V44.0BChat Q4_K_M·401.7 t/s	Q4_K_M	4.2 GB4%	401.7 t/s	33K	S100, Runs great
Sarashina2.2 3B Instruct v0.13.4BChat Q4_K_M·439.5 t/s	Q4_K_M	3.7 GB4%	439.5 t/s	8K	S100, Runs great
Tiny MistralForCausalLM 0.1513960Chat Q4_K_M·3882.7 t/s	Q4_K_M	0.5 GB0%	3882.7 t/s	33K	S100, Runs great
Step 3.7 Flash201.4BVisionFunctions IQ3_XXS·153.8 t/s	IQ3_XXS	92.2 GB96%	153.8 t/s	262K	B62, Decent
Falcon H1 0.5B Instruct521MChat Q4_K_M·1688.1 t/s	Q4_K_M	1.2 GB1%	1688.1 t/s	16K	S100, Runs great
SmolLM3 3B ONNX3BChat Q4_K_M·517.7 t/s	Q4_K_M	3.3 GB3%	517.7 t/s	66K	S100, Runs great
Mistral Small 4 119B 2603119.4BChatFunctions Q4_K_M·175.6 t/s	Q4_K_M	81.6 GB85%	175.6 t/s	1049K	S92, Runs great
Qwen3 Embedding 0.6B596MChatFunctions Q4_K_M·1512.7 t/s	Q4_K_M	1.6 GB2%	1512.7 t/s	33K	S100, Runs great
Datarus R1 14B Preview14.8BChatReasoning Q4_K_M·121.8 t/s	Q4_K_M	12.4 GB13%	121.8 t/s	131K	S95, Runs great
Cogito V1 Preview Qwen 32B32BChat Q4_K_M·58.1 t/s	Q4_K_M	23.8 GB25%	58.1 t/s	131K	A83, Runs well

Rent NVIDIA RTX PRO 6000 Blackwell Max-Q Workstation Edition in the cloud

Hourly rate on demand for one RTX PRO 6000 Blackwell Max-Q Workstation Edition.

Vast.aiMarketplace
from$1.50/hr
Deploy

Buying one ($8,565) costs as much as ~5,700 hours of rental, about 24 months at 8 hours a day.

Cost per million tokens

Output-token cost on an RTX PRO 6000 Blackwell Max-Q Workstation Edition rented at $1.50/hr, one request at a time. Batch several users on the same card and the cost per token drops several-fold.

Model	Quant	Speed	Per 1M output
NVIDIA Nemotron 3.5 Lightning 30B A3B BF16	Q4_K_M	244 tok/s	$1.71$0.010 input
GLM 4.7 Flash	Q4_K_M	196 tok/s	$2.12$0.019 input
Qwen3.8 27B	Q4_K_M	67 tok/s	$6.22$0.12 input
Muse Glimmer 30B	Q4_K_M	64 tok/s	$6.55$0.13 input
Gemma 4 31B IT	Q4_K_M	57 tok/s	$7.29$0.13 input

RTX PRO 6000 Blackwell Max-Q Workstation Edition specs, power and PSU

Specs

Architecture: Blackwell
VRAM: 96 GB GDDR7
Memory bandwidth: 1792.0 GB/s
FP16 (dense): 438.90 TFLOPS
CUDA cores: 24,064
Tensor cores: 752
Compute capability: 12.0
TDP: 300 W
Released: 2025-04-01
MSRP: $8,565

RTX PRO 6000 Blackwell Max-Q Workstation Edition FAQ

What is the largest model the RTX PRO 6000 Blackwell Max-Q Workstation Edition can run?

Mistral Medium 3.5 128B (127.7B) is the largest at 4-bit or better: at Q4_K_M it uses 82.8 GB of 96 GB, and runs at about 15.0 tok/s.

Can the RTX PRO 6000 Blackwell Max-Q Workstation Edition run Qwen3.8 27B?

Yes. Qwen3.8 27B fits at Q4_K_M, using 17.9 GB of 96 GB, and it is the best model that runs well on this card.

How many tokens per second does the RTX PRO 6000 Blackwell Max-Q Workstation Edition give?

About 66.9 tok/s on Qwen3.8 27B at Q4_K_M, with the first token after 1.2 s on a 4K-token prompt.

What power supply does the RTX PRO 6000 Blackwell Max-Q Workstation Edition need?

Plan a 600 W PSU (2× the 300 W TDP).

Is 96 GB enough for coding and agents?

Yes for coding: Qwen3.8 27B, the best of the 14 coding models that fit, runs at about 67 tok/s.

Best coding LLMs 48 GB VRAM GPUs with 96 GB or more RTX 5090 RTX 4090