What is the difference between Llama 3.1 405B and Hermes 2 Pro Llama 3 8B?

Llama 3.1 405B is a 405B model from Meta (Llama 3 family), while Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.

Llama 3.1 405B vs Hermes 2 Pro Llama 3 8B

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Llama 3.1 405B

Meta · 405B

Chat

Hermes 2 Pro Llama 3 8B

Nous Research · 8.0B

Chat

Specifications

	Llama 3.1 405B	Hermes 2 Pro Llama 3 8B
Parameters	405B	8.0B
Context	—	8K
Architecture	—	LlamaForCausalLM
License	Llama 3.1 Community	Llama 3 Community
Downloads	514.6K	15.7K
Released	Sep 2024	Sep 2024

VRAM by Quantization: Llama 3.1 405B vs Hermes 2 Pro Llama 3 8B

Quantization	Bits	Llama 3.1 405B VRAM	Hermes 2 Pro Llama 3 8B VRAM
BF16	16.00	891 GB	—
FP16	16.00	—	16.6 GB

Verdict

Llama 3.1 405B is the more widely downloaded of the two.

Frequently Asked Questions

What is the difference between Llama 3.1 405B and Hermes 2 Pro Llama 3 8B?: Llama 3.1 405B is a 405B model from Meta (Llama 3 family), while Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.