Selfrag Llama2 7B vs Llama 2 7B Chat HF Function Calling v2

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Specifications

Selfrag Llama2 7BLlama 2 7B Chat HF Function Calling v2
Parameters7B7B
Context4K4K
ArchitectureLlamaForCausalLMLlamaForCausalLM
LicenseMIT
Downloads2.8K1.4K
ReleasedJan 2024Nov 2023

VRAM by Quantization: Selfrag Llama2 7B vs Llama 2 7B Chat HF Function Calling v2

QuantizationBitsSelfrag Llama2 7B VRAMLlama 2 7B Chat HF Function Calling v2 VRAM
Q2_K3.404.3 GB
Q3_K_M3.904.8 GB
Q3_K_S3.504.4 GB
Q4_K_M4.805.6 GB
Q5_K_M5.706.4 GB
Q6_K6.607.2 GB
Q8_08.008.4 GB

Verdict

Selfrag Llama2 7B is the more widely downloaded of the two.

Frequently Asked Questions

Which has a longer context window, Selfrag Llama2 7B or Llama 2 7B Chat HF Function Calling v2?

Selfrag Llama2 7B supports 4,096 tokens and Llama 2 7B Chat HF Function Calling v2 supports 4,096 tokens.

What is the difference between Selfrag Llama2 7B and Llama 2 7B Chat HF Function Calling v2?

Selfrag Llama2 7B is a 7B model from selfrag (Llama 2 family), while Llama 2 7B Chat HF Function Calling v2 is a 7B model from Trelis (Llama 2 family). Compare their VRAM requirements above to see which fits your GPU or Mac.