Which has a longer context window, Meta Llama 3 70B Instruct Abliterated V3.5 or Hermes 2 Pro Llama 3 8B?

Meta Llama 3 70B Instruct Abliterated V3.5 supports 8,192 tokens and Hermes 2 Pro Llama 3 8B supports 8,192 tokens.

What is the difference between Meta Llama 3 70B Instruct Abliterated V3.5 and Hermes 2 Pro Llama 3 8B?

Meta Llama 3 70B Instruct Abliterated V3.5 is a 70.6B model from failspy (Llama 3 family), while Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.

Meta Llama 3 70B Instruct Abliterated V3.5 vs Hermes 2 Pro Llama 3 8B

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Meta Llama 3 70B Instruct Abliterated V3.5

failspy · 70.6B

Chat

Hermes 2 Pro Llama 3 8B

Nous Research · 8.0B

Chat

Specifications

	Meta Llama 3 70B Instruct Abliterated V3.5	Hermes 2 Pro Llama 3 8B
Parameters	70.6B	8.0B
Context	8K	8K
Architecture	LlamaForCausalLM	LlamaForCausalLM
License	Llama 3 Community	Llama 3 Community
Downloads	8.6K	15.7K
Released	May 2024	Sep 2024

VRAM by Quantization: Meta Llama 3 70B Instruct Abliterated V3.5 vs Hermes 2 Pro Llama 3 8B

Quantization	Bits	Meta Llama 3 70B Instruct Abliterated V3.5 VRAM	Hermes 2 Pro Llama 3 8B VRAM
BF16	16.00	142.1 GB	—
FP16	16.00	—	16.6 GB

Verdict

Hermes 2 Pro Llama 3 8B is the more widely downloaded of the two.

Frequently Asked Questions

Which has a longer context window, Meta Llama 3 70B Instruct Abliterated V3.5 or Hermes 2 Pro Llama 3 8B?: Meta Llama 3 70B Instruct Abliterated V3.5 supports 8,192 tokens and Hermes 2 Pro Llama 3 8B supports 8,192 tokens.
What is the difference between Meta Llama 3 70B Instruct Abliterated V3.5 and Hermes 2 Pro Llama 3 8B?: Meta Llama 3 70B Instruct Abliterated V3.5 is a 70.6B model from failspy (Llama 3 family), while Hermes 2 Pro Llama 3 8B is a 8.0B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.