Llama 3.1 8B Instruct vs Meta Llama 3 8B Instruct
Llama 3.1 8B Instruct and Meta Llama 3 8B Instruct match in llmrun Score, with values of 62.5 versus 61.7; both fit 24 GB at Q4_K_M.
Model A · Meta
Llama 3.1 8B Instruct8.0B · 128K context · Llama 3.1 Community · Jul 2024
Choose Llama 3.1 8B Instruct if you want…
Also does function-calling
Meta Llama 3 8B Instruct doesn't list it
Newer release
Jul 2024 vs Apr 2024
Meta Llama 3 8B Instruct: no clear edge over Llama 3.1 8B Instruct in the data we have.
On your hardware
Each model at its default quant (Q4_K_M), a smaller one when it must. Estimates, ±20%.
8 GB
RTX 4060 · 8 GB tier
Llama 3.1 8B Instruct
Q4_K_M · ~33 tok/s
7.9 GB · up to 16K
Meta Llama 3 8B Instruct
Q4_K_M · ~33 tok/s
7.9 GB · up to 16K
12 GB
RTX 3060 12GB · 12 GB tier
Llama 3.1 8B Instruct
Q4_K_M · ~44 tok/s
7.9 GB · up to 32K
Meta Llama 3 8B Instruct
Q4_K_M · ~44 tok/s
7.9 GB · up to 32K
16 GB
RTX 5060 Ti 16GB · 16 GB tier
Llama 3.1 8B Instruct
Q4_K_M · ~55 tok/s
7.9 GB · up to 32K
Meta Llama 3 8B Instruct
Q4_K_M · ~55 tok/s
7.9 GB · up to 32K
24 GBreference
RTX 4090 · 24 GB tier
Llama 3.1 8B Instruct
Q4_K_M · ~124 tok/s
7.9 GB · up to 64K
Meta Llama 3 8B Instruct
Q4_K_M · ~124 tok/s
7.9 GB · up to 32K
32 GB
RTX 5090 · 32 GB tier
Llama 3.1 8B Instruct
Q4_K_M · ~220 tok/s
7.9 GB · up to 128K
Meta Llama 3 8B Instruct
Q4_K_M · ~220 tok/s
7.9 GB · up to 32K
48 GB
RTX A6000 · 48 GB tier
Llama 3.1 8B Instruct
Q4_K_M · ~94 tok/s
7.9 GB · up to 128K
Meta Llama 3 8B Instruct
Q4_K_M · ~94 tok/s
7.9 GB · up to 32K
Mac 32 GB
Mac Mini M4 · Macs
Llama 3.1 8B Instruct
Q4_K_M · ~16 tok/s
7.9 GB · up to 128K
Meta Llama 3 8B Instruct
Q4_K_M · ~16 tok/s
7.9 GB · up to 32K
Mac 64 GB
Mac Studio M4 Max · Macs
Llama 3.1 8B Instruct
Q4_K_M · ~72 tok/s
7.9 GB · up to 128K
Meta Llama 3 8B Instruct
Q4_K_M · ~72 tok/s
7.9 GB · up to 32K
Mac 128 GB
Mac Studio M4 Max · Macs
Llama 3.1 8B Instruct
Q4_K_M · ~72 tok/s
7.9 GB · up to 128K
Meta Llama 3 8B Instruct
Q4_K_M · ~72 tok/s
7.9 GB · up to 32K
Reference GPU: RTX 4090. Tinted cell = the better pick on that machine (fits, more headroom, or at least 10% faster).
Overall
Llama 3.1 8B Instruct
Meta Llama 3 8B Instruct
Coding
Llama 3.1 8B Instruct
Meta Llama 3 8B Instruct
no data
Science
Llama 3.1 8B Instruct
Meta Llama 3 8B Instruct
no data
Reasoning
Llama 3.1 8B Instruct
Meta Llama 3 8B Instruct
Llama 3.1 8B Instruct · #88 of 92 open models · #31 of 34 that fit 24 GB
Meta Llama 3 8B Instruct · #89 of 92 open models · #32 of 34 that fit 24 GB
Benchmarks
8 shared boards: Llama 3.1 8B Instruct leads 4, Meta Llama 3 8B Instruct leads 3 · Benchmarks imported Oct 2026
Llama 3.1 8B Instruct
27.0%#86/97 open
IndependentEpoch AI · Jul 2024
Meta Llama 3 8B Instruct
26.1%#88/97 open
IndependentEpoch AI · Apr 2024
Llama 3.1 8B Instruct
1211.3#141/186 open
ArenaLMArena · Oct 2026
Meta Llama 3 8B Instruct
1223.6#136/186 open
ArenaLMArena · Oct 2026
Llama 3.1 8B Instruct
1.7%#76/85 open
IndependentEpoch AI · Jul 2024
Meta Llama 3 8B Instruct
1.9%#75/85 open
IndependentEpoch AI · Apr 2024
Llama 3.1 8B Instruct
44.3%#87/144 open
IndependentTIGER-Lab
Meta Llama 3 8B Instruct
41.0%#99/144 open
IndependentTIGER-Lab
Llama 3.1 8B Instruct
22.9%#28/39 open
IndependentEpoch AI · Jul 2024
Meta Llama 3 8B Instruct
6.1%#36/39 open
IndependentEpoch AI · Apr 2024
Llama 3.1 8B Instruct
56.1%#55/85 open
Lab-reportedEpoch AI · Jul 2024
Meta Llama 3 8B Instruct
68.8%#30/85 open
Lab-reportedEpoch AI · Apr 2024
Llama 3.1 8B Instruct
0.0%#57/67 open
IndependentEpoch AI · Jul 2024
Meta Llama 3 8B Instruct
0.0%#59/67 open
IndependentEpoch AI · Apr 2024
Llama 3.1 8B Instruct
50.9%#59/68 open
Lab-reportedEpoch AI · Jul 2024
Meta Llama 3 8B Instruct
43.9%#66/68 open
Lab-reportedEpoch AI · Apr 2024
13 more boards (other shared and single-model boards)
Only Llama 3.1 8B Instruct (8)
Only Meta Llama 3 8B Instruct (5)
- ForecastBench58.6
- WinoGrande65.0%
- ARC Challenge82.8%
- OpenBookQA82.6%
- TriviaQA67.7%
VRAM by quantization
Memory to load the model and 2K context; below it, the total at 32K and 128K context. Lighter side in bold.
Q2_K
Llama 3.1 8B Instruct
3.8 GB3.2 GB file
32K 9.3 GB · 128K 26.9 GB
Meta Llama 3 8B Instruct
3.8 GB3.2 GB file
32K 9.3 GB · 128K 26.9 GB
Q3_K_S
Llama 3.1 8B Instruct
3.9 GB3.7 GB file
32K 9.4 GB · 128K 27.0 GB
Meta Llama 3 8B Instruct
3.9 GB3.7 GB file
32K 9.4 GB · 128K 27.0 GB
Q3_K_M
Llama 3.1 8B Instruct
4.3 GB4.0 GB file
32K 9.8 GB · 128K 27.4 GB
Meta Llama 3 8B Instruct
4.3 GB4.0 GB file
32K 9.8 GB · 128K 27.4 GB
Q4_0
Llama 3.1 8B Instruct
4.4 GB4.7 GB file
32K 9.9 GB · 128K 27.5 GB
Meta Llama 3 8B Instruct
4.4 GB4.7 GB file
32K 9.9 GB · 128K 27.5 GB
Q4_K_M
Llama 3.1 8B Instruct
5.3 GB4.9 GB file
32K 10.8 GB · 128K 28.4 GB
Meta Llama 3 8B Instruct
5.3 GB4.9 GB file
32K 10.8 GB · 128K 28.4 GB
Q5_K_M
Llama 3.1 8B Instruct
6.3 GB5.7 GB file
32K 11.8 GB · 128K 29.4 GB
Meta Llama 3 8B Instruct
6.3 GB5.7 GB file
32K 11.8 GB · 128K 29.4 GB
Q6_K
Llama 3.1 8B Instruct
7.3 GB6.6 GB file
32K 12.8 GB · 128K 30.4 GB
Meta Llama 3 8B Instruct
7.3 GB6.6 GB file
32K 12.8 GB · 128K 30.4 GB
Q8_0
Llama 3.1 8B Instruct
8.8 GB8.5 GB file
32K 14.3 GB · 128K 32.0 GB
Meta Llama 3 8B Instruct
8.8 GB8.5 GB file
32K 14.3 GB · 128K 32.0 GB
20 more quants
IQ2_XXS
Llama 3.1 8B Instruct
2.4 GB2.5 GB file
32K 7.9 GB · 128K 25.6 GB
Meta Llama 3 8B Instruct
2.4 GB2.4 GB file
32K 7.9 GB · 128K 25.6 GB
IQ2_XS
Llama 3.1 8B Instruct
2.7 GB2.6 GB file
32K 8.2 GB · 128K 25.8 GB
Meta Llama 3 8B Instruct
2.7 GB2.6 GB file
32K 8.2 GB · 128K 25.8 GB
IQ2_S
Llama 3.1 8B Instruct
2.8 GB2.8 GB file
32K 8.3 GB · 128K 25.9 GB
Meta Llama 3 8B Instruct
2.8 GB2.8 GB file
32K 8.3 GB · 128K 25.9 GB
IQ2_M
Llama 3.1 8B Instruct
3.0 GB2.9 GB file
32K 8.5 GB · 128K 26.1 GB
Meta Llama 3 8B Instruct
3.0 GB2.9 GB file
32K 8.5 GB · 128K 26.1 GB
IQ3_XXS
Llama 3.1 8B Instruct
3.4 GB3.3 GB file
32K 8.9 GB · 128K 26.5 GB
Meta Llama 3 8B Instruct
3.4 GB3.3 GB file
32K 8.9 GB · 128K 26.5 GB
Q2_K_S
Llama 3.1 8B Instruct
3.5 GB3.0 GB file
32K 9.0 GB · 128K 26.7 GB
Meta Llama 3 8B Instruct
3.5 GB3.0 GB file
32K 9.0 GB · 128K 26.7 GB
IQ3_XS
Llama 3.1 8B Instruct
3.6 GB3.5 GB file
32K 9.1 GB · 128K 26.8 GB
Meta Llama 3 8B Instruct
3.6 GB3.5 GB file
32K 9.1 GB · 128K 26.8 GB
IQ3_S
Llama 3.1 8B Instruct
3.8 GB3.7 GB file
32K 9.3 GB · 128K 26.9 GB
Meta Llama 3 8B Instruct
3.8 GB3.7 GB file
32K 9.3 GB · 128K 26.9 GB
IQ3_M
Llama 3.1 8B Instruct
4.0 GB3.8 GB file
32K 9.5 GB · 128K 27.1 GB
Meta Llama 3 8B Instruct
4.0 GB3.8 GB file
32K 9.5 GB · 128K 27.1 GB
Q3_K_L
Llama 3.1 8B Instruct
4.5 GB4.3 GB file
32K 10.0 GB · 128K 27.7 GB
Meta Llama 3 8B Instruct
4.5 GB4.3 GB file
32K 10.0 GB · 128K 27.7 GB
IQ4_XS
Llama 3.1 8B Instruct
4.8 GB4.4 GB file
32K 10.3 GB · 128K 27.9 GB
Meta Llama 3 8B Instruct
4.8 GB4.4 GB file
32K 10.3 GB · 128K 27.9 GB
IQ4_NL
Llama 3.1 8B Instruct
5.0 GB4.7 GB file
32K 10.5 GB · 128K 28.1 GB
Meta Llama 3 8B Instruct
5.0 GB4.7 GB file
32K 10.5 GB · 128K 28.1 GB
Q4_1
Llama 3.1 8B Instruct
5.0 GB5.1 GB file
32K 10.5 GB · 128K 28.1 GB
Meta Llama 3 8B Instruct
5.0 GB5.1 GB file
32K 10.5 GB · 128K 28.1 GB
Q4_K_S
Llama 3.1 8B Instruct
5.0 GB4.7 GB file
32K 10.5 GB · 128K 28.1 GB
Meta Llama 3 8B Instruct
5.0 GB4.7 GB file
32K 10.5 GB · 128K 28.1 GB
Q4_K_L
Llama 3.1 8B Instruct
5.4 GB5.3 GB file
32K 10.9 GB · 128K 28.5 GB
Meta Llama 3 8B Instruct
not listed
Q5_0
Llama 3.1 8B Instruct
5.5 GB5.6 GB file
32K 11.0 GB · 128K 28.6 GB
Meta Llama 3 8B Instruct
5.5 GB5.6 GB file
32K 11.0 GB · 128K 28.6 GB
Q5_1
Llama 3.1 8B Instruct
6.1 GB6.1 GB file
32K 11.6 GB · 128K 29.2 GB
Meta Llama 3 8B Instruct
6.1 GB6.1 GB file
32K 11.6 GB · 128K 29.2 GB
Q5_K_S
Llama 3.1 8B Instruct
6.1 GB5.6 GB file
32K 11.6 GB · 128K 29.2 GB
Meta Llama 3 8B Instruct
6.1 GB5.6 GB file
32K 11.6 GB · 128K 29.2 GB
Q5_K_L
Llama 3.1 8B Instruct
6.4 GB6.1 GB file
32K 11.9 GB · 128K 29.5 GB
Meta Llama 3 8B Instruct
not listed
BF16
Llama 3.1 8B Instruct
17.7 GB16.1 GB file
32K 23.2 GB · 128K 40.8 GB
Meta Llama 3 8B Instruct
17.7 GB~16.1 GB file
32K 23.2 GB · 128K 40.8 GB
Llama 3.1 8B Instruct
Ollama · Q4_K_M
ollama run hf.co/bartowski/Meta-Llama-3.1-8B-Instruct-GGUF:Q4_K_MMeta Llama 3 8B Instruct
Ollama · Q4_K_M
ollama run hf.co/MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF:Q4_K_M| Spec | Llama 3.1 8B Instruct | Meta Llama 3 8B Instruct |
|---|---|---|
| Publisher | Meta | Meta |
| Parameters | 8.0B | 8.0B |
| Context | 128K tokens | — |
| Modalities | Chat, Function-calling | Chat |
| License | Llama 3.1 Community | Llama 3 Community |
| Released | Jul 2024 | Apr 2024 |
Frequently Asked Questions
Which is better, Llama 3.1 8B Instruct or Meta Llama 3 8B Instruct?
Llama 3.1 8B Instruct and Meta Llama 3 8B Instruct match in llmrun Score, with values of 62.5 versus 61.7; both fit 24 GB at Q4_K_M. Choose Llama 3.1 8B Instruct for also does function-calling and newer release.
Which needs less VRAM, Llama 3.1 8B Instruct or Meta Llama 3 8B Instruct?
At Q4_K_M, Llama 3.1 8B Instruct requires 5.3 GB while Meta Llama 3 8B Instruct needs 5.3 GB, making Llama 3.1 8B Instruct the easier model to run on your local setup.
Which is faster on RTX 4090?
Estimated decode speed on RTX 4090 is about 124 tok/s for Llama 3.1 8B Instruct (Q4_K_M) and 124 tok/s for Meta Llama 3 8B Instruct (Q4_K_M), so Llama 3.1 8B Instruct is faster. Estimates, ±20%.
Can I run Llama 3.1 8B Instruct or Meta Llama 3 8B Instruct on a 16 GB GPU?
Llama 3.1 8B Instruct fits at Q4_K_M; Meta Llama 3 8B Instruct fits at Q4_K_M.