llmrun

Llama 3 Models — Hardware Requirements

65 Llama 3 models from Meta and the community, from the smallest that runs in 1.6 GB of VRAM at Q4 up to 405.9B parameters. Every row links to full quantization tables and GPU compatibility.

All Llama 3 Models by Size

ModelParamsContext
LLaMA3.1 8B Instruct DFlash UltraChat1.0B41K
Llama 3.2 1B Instruct1.2B131K
Llama 3.2 1B1.2B—
Llama 3.2 3B Instruct3.2B131K
Llama 3.2 3B3.2B—
Llama 3.2 Korean Bllossom 3B3.2B131K
Llama 3.1 Nemotron Nano 8B V18B131K
Llama3.1 Typhoon2 Audio 8B Instruct8B131K
Llama 3.1 8B Instruct8.0B131K
Meta Llama 3 8B Instruct8.0B—
Llama 3.1 8B8.0B—
Meta Llama 3 8B8.0B—
Saiga Llama3 8B8.0B8K
Llama 3.1 SauerkrautLM 8B Instruct8.0B131K
KONI Llama3.1 8B Instruct 202410248.0B131K
Llama3.1 Typhoon2 8B Instruct8.0B131K
Llama 3 8B Instruct Gradient 1048k8.0B1049K
Llama 3 ELYZA JP 8B8.0B8K
Llama 3.1 Tulu 3 8B8.0B131K
Hermes 2 Pro Llama 3 8B8.0B8K
Idefics3 8B Llama38.5B131K
Llama 3.1 Nemotron Nano VL 8B V18.7B—
Llama 3.2 11B Vision Instruct10.7B—
Llama 3 3 Nemotron Super 49B V1 549.9B131K
Llama 3 3 Nemotron Super 49B V149.9B131K
Llama 3 1 Nemotron 51B Instruct51B131K
Llama 3.3 70B Instruct70.6B131K
Llama 3.1 70B Instruct70.6B131K
Meta Llama 3 70B Instruct70.6B—
Hermes 2 Theta Llama 3 70B70.6B8K
Meta Llama 3 70B70.6B—
Llama 3.1 70B70.6B—
Llama 3.1 Tulu 3 70B70.6B131K
Llama 3.1 Tulu 3 70B DPO70.6B131K
Llama 3.2 90B Vision Instruct88.6B—
Llama 3 1 Nemotron Ultra 253B V1253.4B131K
Llama 3.1 405B Instruct405.9B—
Llama 3.1 405B405.9B—
Community variants and fine-tunes(22)
ModelParamsContext
Llama 3.2 1B MathCodeInstruct 5k1.2B131K
Hermes 3 Llama 3.2 3B3B131K
Llama3 OpenBioLLM 8B8B8K
Hermes 3 Llama 3.1 8B8.0B131K
Meta Llama 3.1 8B Instruct Abliterated8.0B131K
Llama 3.1 8B Lexi Uncensored v28.0B131K
Meta Llama 3 8B Instruct Abliterated v38.0B8K
Dobby Mini Unhinged Llama 3.1 8B8.0B131K
Llama3 8B Chinese Chat8.0B8K
Bella Bartender 8B Llama3.18.0B131K
Finance Llama3 8B8.0B8K
Llama 3.1 Nemotron Safety Guard 8B v38.0B131K
Llama 3 Korean Bllossom 8B8.0B8K
Human Like LLama3 8B Instruct8.0B8K
Dolphin 2.9 Llama3 8B8.0B8K
Llama3 OpenBioLLM 70B70B8K
Hermes 3 Llama 3.1 70B70.6B131K
Llama 3.3 70B Instruct Abliterated70.6B131K
Llama 3.1 Nemotron 70B Instruct HF70.6B131K
Llama 3.1 70B LatamGPT SFT 1.070.6B4K
Llama 3.3 Nemotron 70B Reward70.6B131K
Dolphin 2.9.1 Llama 3 70B70.6B8K

How Llama 3 Compares — llmrun Composite Score

Llama 3.1 405B Instruct is the highest-scoring Llama 3 model with an llmrun Composite Score of 83.5 — #82 among 106 open models. The top proprietary model, Gemini 4 Carbon, scores 158.6. Click a model to see its full benchmark breakdown.

Gemini 4 Carbon · proprietary158.6
GPT 6 Astra · proprietary156.2
Claude Opus 5.5 · proprietary153.0
GPT 6.1 Sol · proprietary151.7
GPT 6.1 Terra · proprietary150.1
Kimi K3132.7
GLM 5.3130.1
llmrun Composite Score, open and proprietary models (how it is built) · ■ Llama 3 · ■ other open models · ■ proprietary · bars start at 60

Frequently Asked Questions

How much VRAM do I need to run a Llama 3 model?
The smallest Llama 3 model, Llama 3.2 1B MathCodeInstruct 5k, runs from 1.6 GB of VRAM at Q4_K_M (smaller low-bit quantizations start at 0.9 GB with a noticeable quality loss). Larger family members need proportionally more — see the table above for every model.
Which Llama 3 models can I run on a 16 GB GPU?
38 of 60 Llama 3 models fit in 16 GB of VRAM at Q4_K_M, including Llama 3.2 1B Instruct, Llama 3.1 8B Instruct, Llama 3.2 3B Instruct.
What is the most popular Llama 3 model to run locally?
Llama 3.2 1B Instruct is the most downloaded Llama 3 model in local-friendly quantized formats. It runs from 2.3 GB of VRAM at Q4_K_M.
How do Llama 3 models score on benchmarks?
Llama 3.1 405B Instruct leads the family with an llmrun Composite Score of 83.5, ranking #82 among 106 open models, while the top proprietary model, Gemini 4 Carbon, scores 158.6. See the comparison chart above for the full standings.