Best AI Models for AMD Radeon RX 6600M (8 GB)

Runs 7–9B models well; 14B doesn't fit in 8 GB.

8 GB GDDR6224 GB/s18 TFLOPS FP16100 WRDNA 2 2021

8 GB at 224 GB/s: ~7-8B Q4 models, no more. Not on AMD's official ROCm list; the Vulkan backend (llama.cpp, LM Studio) is the easy path.

What LLMs can the RX 6600M run?

#	Model	Speed	Quant · VRAM
1	Qwen3.5 9BAlibabaHow to run → Q4_K_M · 6.6 GB · 21.1 t/s	21.1 tok/s	Q4_K_M · 6.6 GB
2	Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 41.2 t/s	41.2 tok/s	Q4_K_M · 3.4 GB
3	Gemma 2 9B ITGoogle Q4_K_M · 7.3 GB · 22.0 t/s	22.0 tok/s	Q4_K_M · 7.3 GB
4	Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 47.3 t/s	47.3 tok/s	Q4_K_M · 5.0 GB
5	Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 85.1 t/s	85.1 tok/s	Q4_K_M · 5.5 GB

#	Model	Speed	Reasoning Score	Quant · VRAM
1	Qwen3.5 9BAlibabaHow to run → Q4_K_M · 6.6 GB · 21.1 t/s	21.1 tok/s		Q4_K_M · 6.6 GB
2	Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 47.3 t/s	47.3 tok/s		Q4_K_M · 5.0 GB
3	Qwen2.5 7B InstructAlibaba Q4_K_M · 5.8 GB · 26.9 t/s	26.9 tok/s		Q4_K_M · 5.8 GB
4	Gemma 2 9B ITGoogle Q4_K_M · 7.3 GB · 22.0 t/s	22.0 tok/s	overall	Q4_K_M · 7.3 GB
5	Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 85.1 t/s	85.1 tok/s		Q4_K_M · 5.5 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 41.2 t/s	41.2 tok/s	Q4_K_M · 3.4 GB
2	Qwen3.5 9BAlibaba Q4_K_M · 6.6 GB · 21.1 t/s	21.1 tok/s	Q4_K_M · 6.6 GB
3	Gemma 4 E4B ITGoogle Q4_K_M · 5.6 GB · 25.3 t/s	25.3 tok/s	Q4_K_M · 5.6 GB
4	Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 85.1 t/s	85.1 tok/s	Q4_K_M · 5.5 GB
5	MiniCPM5 2BOpenBMB Q4_K_M · 2.5 GB · 70.7 t/s	70.7 tok/s	Q4_K_M · 2.5 GB

#	Model	Speed ↓	Quant · VRAM
1	Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 41.2 t/s	41.2 tok/s	Q4_K_M · 3.4 GB
2	Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 85.1 t/s	85.1 tok/s	Q4_K_M · 5.5 GB
3	MiniCPM5 2BOpenBMB Q4_K_M · 2.5 GB · 70.7 t/s	70.7 tok/s	Q4_K_M · 2.5 GB
4	Gemma 4 E4B ITGoogle Q4_K_M · 5.6 GB · 25.3 t/s	25.3 tok/s	Q4_K_M · 5.6 GB
5	Qwen3.5 9BAlibaba Q4_K_M · 6.6 GB · 21.1 t/s	21.1 tok/s	Q4_K_M · 6.6 GB

#	Model	Speed	Quant · VRAM
1	Qwen3.5 9BAlibabaHow to run → Q4_K_M · 6.6 GB · 21.1 t/s	21.1 tok/s	Q4_K_M · 6.6 GB
2	Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 41.2 t/s	41.2 tok/s	Q4_K_M · 3.4 GB
3	Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 47.3 t/s	47.3 tok/s	Q4_K_M · 5.0 GB
4	MiMo V2.6 Distill Qwen 9BXiaomi Q4_K_M · 6.5 GB · 21.6 t/s	21.6 tok/s	Q4_K_M · 6.5 GB
5	MiniCPM V 4.7 1BOpenBMB Q4_K_M · 1.6 GB · 105 t/s	105 tok/s	Q4_K_M · 1.6 GB

See all 218 models on the RX 6600M →Best quant that fits · speeds estimated on this card

About the RX 6600M

The RX 6600M runs 7–9B models well. RDNA 2 generation, released 2021.

GenerationRDNA 2released 2021

RX 6600M strengths and weaknesses

Strengths

Runs 7–9B models: Qwen3.5 9B at 21.1 tok/s in 6.6 GB
Low power draw: 100 W board power; a 200 W PSU is enough

Weaknesses

14B models don't fit: Qwen3 14B needs 11.9 GB at Q4 vs 8 GB here
Little room for context: Qwen3.5 9B uses 6.6 of 8 GB, 1.4 GB left
Slow prompt reading: A 4K-token prompt on Qwen3.5 9B waits 20.5 s for the first token
ROCm, not CUDA: No FP8 weights; MXFP4 only through llama.cpp, not vLLM

Similar GPUs

Cards people weigh against the RX 6600M, each with the one reason it is worth a look. Speeds on Qwen3.5 9B.

39% faster, same 8 GBRTX 4060 Ti 8GBNVIDIA · 8 GB · Ada Lovelace

▲ 39% speedsame 8 GB$399rent $0.15/hr

4 GB more and 74% fasterRTX 3060 12GBNVIDIA · 12 GB · Ampere

▲ 74% speed▲ 4 GB$329rent $0.06/hr

4 GB more and nearly 2× the speedRX 9070 GREAMD · 12 GB · RDNA 4

▲ 93% speed▲ 4 GB$549

32% faster, same 8 GBRTX 4060NVIDIA · 8 GB · Ada Lovelace

▲ 32% speedsame 8 GB$520rent $0.08/hr

8 GB more and 3.5× the speedRTX 4080NVIDIA · 16 GB · Ada Lovelace

▲ 247% speed▲ 8 GB$1,199rent $0.24/hr

8 GB more and 3.6× the speedRTX 4080 SUPERNVIDIA · 16 GB · Ada Lovelace

▲ 256% speed▲ 8 GB$999rent $0.26/hr

RX 6600M tokens per second by model size

Output speed depends on memory bandwidth (224 GB/s). Grey rows need more than 8 GB.

9BQwen3.5 9B · Q4_K_M · 6.6 GB
21.1tok/s
14BQwen3 14B · not at 4-bit
needs 11.9 GB
27–31BQwen3.8 27B · not at 4-bit
needs 17.9 GB
35B MoEQwen3.6 35B A3B · not at 4-bit
needs 22.0 GB
70BLlama 3.3 70B Instruct · not at 4-bit
needs 51.3 GB
120B MoEGPT OSS 120B · not at 4-bit
needs 70.8 GB

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 842 models on the RX 6600M

Featured only

Best quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with AMD Radeon RX 6600M — ranked by Score, recency and Fit
Model	Quant	VRAM	Speed	Context	Fit
Llama2 Kv Sharing3MChat Q4_K_M·448.0 t/s	Q4_K_M	0.3 GB4%	448.0 t/s	2K	S100, Runs great
Tiny Qwen3ForCausalLM2MChatFunctions Q4_K_M·448.0 t/s	Q4_K_M	0.6 GB7%	448.0 t/s	41K	S100, Runs great
Openai GPT120MChat Q4_K_M·1680.0 t/s	Q4_K_M	0.1 GB1%	1680.0 t/s	1K	S100, Runs great
Yi 1.5 6B Chat6.1BChat Q4_K_M·33.0 t/s	Q4_K_M	4.2 GB53%	33.0 t/s	4K	A72, Runs well
Internlm2 5 7B Chat7BChat Q4_K_M·28.2 t/s	Q4_K_M	6.7 GB83%	28.2 t/s	33K	A65, Runs well
Dobby Mini Unhinged Llama 3.1 8B8.0BChatRoleplay Q4_K_M·24.9 t/s	Q4_K_M	7.3 GB91%	24.9 t/s	131K	B50, Decent
NVIDIA Nemotron Nano 9B v2 Japanese8.9BChat Q4_K_M·22.3 t/s	Q4_K_M	6.0 GB76%	22.3 t/s	131K	B62, Decent
Llama 160M162MChat Q4_K_M·286.0 t/s	Q4_K_M	0.5 GB6%	286.0 t/s	2K	S100, Runs great
Gpt2 Xl1.6BChat Q4_K_M·126.8 t/s	Q4_K_M	1.1 GB13%	126.8 t/s	1K	S95, Runs great
Qwen3Guard Gen 4B4.4BChat Q4_K_M·42.8 t/s	Q4_K_M	4.5 GB56%	42.8 t/s	33K	A77, Runs well
Pythia 1.4B1.5BChat Q4_K_M·134.4 t/s	Q4_K_M	1 GB13%	134.4 t/s	2K	S95, Runs great
Gemma 4 12B IT AEON Abliterated K4 BF1612.0BChatReasoningFunctions Q3_K_M·19.5 t/s	Q3_K_M	7.7 GB96%	19.5 t/s	262K	C35, Usable
Gemma 3n E2B IT5.4BVision Q4_K_M·37.4 t/s	Q4_K_M	5.9 GB74%	37.4 t/s	—	A74, Runs well
Pythia 410M Deduped506MChat Q4_K_M·407.3 t/s	Q4_K_M	0.3 GB4%	407.3 t/s	2K	S100, Runs great
LFM2 8B A1B8.3BChat Q4_K_M·81.3 t/s	Q4_K_M	5.5 GB69%	81.3 t/s	128K	S88, Runs great

RX 6600M specs, power and PSU

Specs

Architecture: RDNA 2
VRAM: 8 GB GDDR6
Memory bandwidth: 224.0 GB/s
FP16 (dense): 17.55 TFLOPS
Stream processors: 1,792
TDP: 100 W
Released: 2021-05-31

RX 6600M FAQ

What is the largest model the RX 6600M can run?

Qwen3.5 9B (9.7B) is the largest at 4-bit or better: at Q4_K_M it uses 6.6 GB of 8 GB, and runs at about 21.1 tok/s.

Can the RX 6600M run 14B models?

No. Qwen3 14B needs 11.9 GB at Q4, more than the 8 GB on this card.

How many tokens per second does the RX 6600M give?

About 21.1 tok/s on Qwen3.5 9B at Q4_K_M, with the first token after 20.5 s on a 4K-token prompt.

What power supply does the RX 6600M need?

Plan a 200 W PSU (2× the 100 W TDP).

Is renting cheaper than buying an RX 6600M?

An RTX 3090 (24 GB) rents from $0.18/hr. With regular daily use, owning pays off.

Best coding LLMs 8 GB VRAM 12 GB VRAM GPUs with 8 GB or more RTX 5080 RTX 3080 Ti