DeepSeek Coder v2 Lite Base vs DeepSeek Coder v2 Lite Instruct
Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.
Specifications
| DeepSeek Coder v2 Lite Base | DeepSeek Coder v2 Lite Instruct | |
|---|---|---|
| Parameters | 15.7B | 15.7B |
| Context | 164K | 164K |
| Architecture | DeepseekV2ForCausalLM | DeepseekV2ForCausalLM |
| License | Other | Other |
| Downloads | 4.8K | 877.2K |
| Released | Jul 2024 | Jul 2024 |
VRAM by Quantization: DeepSeek Coder v2 Lite Base vs DeepSeek Coder v2 Lite Instruct
| Quantization | Bits | DeepSeek Coder v2 Lite Base VRAM | DeepSeek Coder v2 Lite Instruct VRAM |
|---|---|---|---|
| Q2_K | 3.40 | — | 7.4 GB |
| Q3_K_M | 3.90 | — | 8.4 GB |
| Q3_K_S | 3.50 | — | 7.6 GB |
| Q4_0 | 4.00 | — | 8.6 GB |
| Q4_K_M | 4.80 | — | 10.2 GB |
| Q5_K_M | 5.70 | — | 11.9 GB |
| Q6_K | 6.60 | — | 13.7 GB |
| Q8_0 | 8.00 | — | 16.5 GB |
Verdict
DeepSeek Coder v2 Lite Instruct is the more widely downloaded of the two.
Frequently Asked Questions
- Which has a longer context window, DeepSeek Coder v2 Lite Base or DeepSeek Coder v2 Lite Instruct?
DeepSeek Coder v2 Lite Base supports 163,840 tokens and DeepSeek Coder v2 Lite Instruct supports 163,840 tokens.
- What is the difference between DeepSeek Coder v2 Lite Base and DeepSeek Coder v2 Lite Instruct?
DeepSeek Coder v2 Lite Base is a 15.7B model from DeepSeek (DeepSeek Coder family), while DeepSeek Coder v2 Lite Instruct is a 15.7B model from DeepSeek (DeepSeek Coder family). Compare their VRAM requirements above to see which fits your GPU or Mac.