Llama3 8B DarkIdol 2.3 Uncensored 32K vs Hermes 3 Llama 3.2 3B

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Llama3 8B DarkIdol 2.3 Uncensored 32K

aifeifei798 · 8.0B

ChatRoleplay
Hermes 3 Llama 3.2 3B

Nous Research · 3B

ChatRoleplay

Specifications

Llama3 8B DarkIdol 2.3 Uncensored 32KHermes 3 Llama 3.2 3B
Parameters8.0B3B
Context131K131K
ArchitectureLlamaForCausalLMLlamaForCausalLM
LicenseLlama 3 CommunityLlama 3 Community
Downloads2.1K77.3K
ReleasedJul 2024Dec 2024

VRAM by Quantization: Llama3 8B DarkIdol 2.3 Uncensored 32K vs Hermes 3 Llama 3.2 3B

QuantizationBitsLlama3 8B DarkIdol 2.3 Uncensored 32K VRAMHermes 3 Llama 3.2 3B VRAM
BF1616.0016.6 GB6.5 GB

Verdict

Hermes 3 Llama 3.2 3B needs less VRAM at BF16 (6.5 GB vs 16.6 GB), so it fits on smaller GPUs. Hermes 3 Llama 3.2 3B is the more widely downloaded of the two.

Frequently Asked Questions

Which needs less VRAM, Llama3 8B DarkIdol 2.3 Uncensored 32K or Hermes 3 Llama 3.2 3B?

At BF16, Llama3 8B DarkIdol 2.3 Uncensored 32K needs 16.6 GB and Hermes 3 Llama 3.2 3B needs 6.5 GB, so Hermes 3 Llama 3.2 3B is the lighter option to run locally.

Which has a longer context window, Llama3 8B DarkIdol 2.3 Uncensored 32K or Hermes 3 Llama 3.2 3B?

Llama3 8B DarkIdol 2.3 Uncensored 32K supports 131,072 tokens and Hermes 3 Llama 3.2 3B supports 131,072 tokens.

What is the difference between Llama3 8B DarkIdol 2.3 Uncensored 32K and Hermes 3 Llama 3.2 3B?

Llama3 8B DarkIdol 2.3 Uncensored 32K is a 8.0B model from aifeifei798 (Llama 3 family), while Hermes 3 Llama 3.2 3B is a 3B model from Nous Research (Llama 3 family). Compare their VRAM requirements above to see which fits your GPU or Mac.