Which has a longer context window, Hermes 2 Pro Llama 3 8B or Hermes 3 Llama 3.2 3B?

Hermes 2 Pro Llama 3 8B supports 8,192 tokens and Hermes 3 Llama 3.2 3B supports 131,072 tokens.

What is the difference between Hermes 2 Pro Llama 3 8B and Hermes 3 Llama 3.2 3B?

Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family), while Hermes 3 Llama 3.2 3B is a 3B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.

Hermes 2 Pro Llama 3 8B vs Hermes 3 Llama 3.2 3B

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Hermes 2 Pro Llama 3 8B

Nous Research · 8.0B

Chat

Hermes 3 Llama 3.2 3B

Nous Research · 3B

ChatRoleplay

Specifications

	Hermes 2 Pro Llama 3 8B	Hermes 3 Llama 3.2 3B
Parameters	8.0B	3B
Context	8K	131K
Architecture	LlamaForCausalLM	LlamaForCausalLM
License	Llama 3 Community	Llama 3 Community
Downloads	15.7K	77.3K
Released	Sep 2024	Dec 2024

VRAM by Quantization: Hermes 2 Pro Llama 3 8B vs Hermes 3 Llama 3.2 3B

Quantization	Bits	Hermes 2 Pro Llama 3 8B VRAM	Hermes 3 Llama 3.2 3B VRAM
BF16	16.00	—	6.5 GB
FP16	16.00	16.6 GB	—

Verdict

Hermes 3 Llama 3.2 3B supports a longer context window (131K tokens). Hermes 3 Llama 3.2 3B is the more widely downloaded of the two.

Frequently Asked Questions

Which has a longer context window, Hermes 2 Pro Llama 3 8B or Hermes 3 Llama 3.2 3B?: Hermes 2 Pro Llama 3 8B supports 8,192 tokens and Hermes 3 Llama 3.2 3B supports 131,072 tokens.
What is the difference between Hermes 2 Pro Llama 3 8B and Hermes 3 Llama 3.2 3B?: Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family), while Hermes 3 Llama 3.2 3B is a 3B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.