Which has a longer context window, Internlm 20B or Internlm 7B?

Internlm 20B supports 4,096 tokens and Internlm 7B supports 2,048 tokens.

What is the difference between Internlm 20B and Internlm 7B?

Internlm 20B is a 20B model from InternLM (InternLM family), while Internlm 7B is a 7B model from InternLM (InternLM family). Compare their VRAM requirements above to see which fits your GPU or Mac.

Internlm 20B vs Internlm 7B

Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.

Internlm 20B

InternLM · 20B

Chat

Internlm 7B

InternLM · 7B

Chat

Specifications

	Internlm 20B	Internlm 7B
Parameters	20B	7B
Context	4K	2K
Architecture	InternLMForCausalLM	InternLMForCausalLM
License	Apache 2.0	—
Downloads	1.6K	1.8K
Released	—	—

VRAM by Quantization: Internlm 20B vs Internlm 7B

Quantization	Bits	Internlm 20B VRAM	Internlm 7B VRAM
BF16	16.00	42.8 GB	—
FP16	16.00	—	15.4 GB

Verdict

Internlm 20B supports a longer context window (4K tokens). Internlm 7B is the more widely downloaded of the two.

Frequently Asked Questions

Which has a longer context window, Internlm 20B or Internlm 7B?: Internlm 20B supports 4,096 tokens and Internlm 7B supports 2,048 tokens.
What is the difference between Internlm 20B and Internlm 7B?: Internlm 20B is a 20B model from InternLM (InternLM family), while Internlm 7B is a 7B model from InternLM (InternLM family). Compare their VRAM requirements above to see which fits your GPU or Mac.