Which has a longer context window, Dolphin 2.9.1 Llama 3 70B or Hermes 2 Pro Llama 3 8B?

Dolphin 2.9.1 Llama 3 70B supports 8,192 tokens and Hermes 2 Pro Llama 3 8B supports 8,192 tokens.

What is the difference between Dolphin 2.9.1 Llama 3 70B and Hermes 2 Pro Llama 3 8B?

Dolphin 2.9.1 Llama 3 70B is a 70.6B model from dphn (Llama 3 family), while Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.

Dolphin 2.9.1 Llama 3 70B vs Hermes 2 Pro Llama 3 8B

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Dolphin 2.9.1 Llama 3 70B

dphn · 70.6B

Chat

Hermes 2 Pro Llama 3 8B

Nous Research · 8.0B

Chat

Specifications

	Dolphin 2.9.1 Llama 3 70B	Hermes 2 Pro Llama 3 8B
Parameters	70.6B	8.0B
Context	8K	8K
Architecture	LlamaForCausalLM	LlamaForCausalLM
License	Llama 3 Community	Llama 3 Community
Downloads	9.0K	15.7K
Released	Jun 2024	Sep 2024

VRAM by Quantization: Dolphin 2.9.1 Llama 3 70B vs Hermes 2 Pro Llama 3 8B

Quantization	Bits	Dolphin 2.9.1 Llama 3 70B VRAM	Hermes 2 Pro Llama 3 8B VRAM
BF16	16.00	142.1 GB	—
FP16	16.00	—	16.6 GB

Verdict

Hermes 2 Pro Llama 3 8B is the more widely downloaded of the two.

Frequently Asked Questions

Which has a longer context window, Dolphin 2.9.1 Llama 3 70B or Hermes 2 Pro Llama 3 8B?: Dolphin 2.9.1 Llama 3 70B supports 8,192 tokens and Hermes 2 Pro Llama 3 8B supports 8,192 tokens.
What is the difference between Dolphin 2.9.1 Llama 3 70B and Hermes 2 Pro Llama 3 8B?: Dolphin 2.9.1 Llama 3 70B is a 70.6B model from dphn (Llama 3 family), while Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.