GPUs with 12–∞ GB VRAM for Running LLMs
Browse 85 GPUs with 12–∞ GB VRAM compatible with running LLM models locally. Compare VRAM, memory bandwidth, and AI performance. Top picks and budget guide
85 GPUs
| GPU | Price |
|---|---|
| RTX 409024 GBGDDR6X · 1,008 GB/s · 450 WNVIDIA · Ada Lovelace · 2022 | about $1,599 |
| RTX 509032 GBGDDR7 · 1,792 GB/s · 575 WNVIDIA · Blackwell · 2025 | about $5,376 |
| RTX 508016 GBGDDR7 · 960 GB/s · 360 WNVIDIA · Blackwell · 2025 | about $1,690 |
| RTX 5070 Ti16 GBGDDR7 · 896 GB/s · 300 WNVIDIA · Blackwell · 2025 | about $1,170 |
| RTX 309024 GBGDDR6X · 936 GB/s · 350 WNVIDIA · Ampere · 2020 | about $1,499 |
| RTX 4080 SUPER16 GBGDDR6X · 736 GB/s · 320 WNVIDIA · Ada Lovelace · 2024 | about $999 |
| RTX 507012 GBGDDR7 · 672 GB/s · 250 WNVIDIA · Blackwell · 2025 | about $840 |
| RTX 4070 Ti SUPER16 GBGDDR6X · 672 GB/s · 285 WNVIDIA · Ada Lovelace · 2024 | about $799 |
| RTX 408016 GBGDDR6X · 717 GB/s · 320 WNVIDIA · Ada Lovelace · 2022 | about $1,199 |
| RX 9070 XT16 GBGDDR6 · 640 GB/s · 304 WAMD · RDNA 4 · 2025 | about $815 |
| RTX 4070 SUPER12 GBGDDR6X · 504 GB/s · 220 WNVIDIA · Ada Lovelace · 2024 | about $599 |
| RTX 4070 Ti12 GBGDDR6X · 504 GB/s · 285 WNVIDIA · Ada Lovelace · 2023 | about $799 |
| RTX PRO 6000 BlackwellPro96 GBGDDR7 · 1,792 GB/s · 600 WNVIDIA · Blackwell · 2025 | about $8,565 |
| RTX 5060 Ti 16GB16 GBGDDR7 · 448 GB/s · 180 WNVIDIA · Blackwell · 2025 | about $429 |
| RX 907016 GBGDDR6 · 640 GB/s · 220 WAMD · RDNA 4 · 2025 | about $800 |
| RX 7900 XTX24 GBGDDR6 · 960 GB/s · 355 WAMD · RDNA 3 · 2022 | about $1,130 |
| RX 9070 GRE12 GBGDDR6 · 432 GB/s · 220 WAMD · RDNA 4 · 2026 | about $549 |
| RTX 407012 GBGDDR6X · 504 GB/s · 200 WNVIDIA · Ada Lovelace · 2023 | about $599 |
| H200 SXMPro141 GBHBM3e · 4,800 GB/s · 700 WNVIDIA · Hopper · 2024 | – |
| Radeon AI PRO R9700Pro32 GBGDDR6 · 640 GB/s · 300 WAMD · RDNA 4 · 2025 | about $1,299 |
| RX 9060 XT 16GB16 GBGDDR6 · 320 GB/s · 160 WAMD · RDNA 4 · 2025 | about $590 |
| B200Pro192 GBHBM3e · 8,000 GB/s · 1000 WNVIDIA · Blackwell · 2024 | – |
| RTX 3060 12GB12 GBGDDR6 · 360 GB/s · 170 WNVIDIA · Ampere · 2021 | about $329 |
| RTX 3090 Ti24 GBGDDR6X · 1,008 GB/s · 450 WNVIDIA · Ampere · 2022 | about $1,999 |
| H100 SXMPro80 GBHBM3 · 3,352 GB/s · 700 WNVIDIA · Hopper · 2022 | – |
Which GPU Do You Need for AI?
The amount of VRAM is the most important specification for running LLMs locally. Most 7B parameter models require 4–8 GB of VRAM at common quantization levels, while 70B models need 24–48 GB. Memory bandwidth determines how fast the model generates tokens — faster bandwidth means faster responses.