Starcoder vs Starcoder2 15B
Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.
Specifications
| Starcoder | Starcoder2 15B | |
|---|---|---|
| Parameters | 15.8B | 16.0B |
| Context | — | 16K |
| Architecture | — | Starcoder2ForCausalLM |
| License | bigcode-openrail-m | bigcode-openrail-m |
| Downloads | 25.4K | 8.4K |
| Released | Oct 2024 | Jun 2024 |
VRAM by Quantization: Starcoder vs Starcoder2 15B
| Quantization | Bits | Starcoder VRAM | Starcoder2 15B VRAM |
|---|---|---|---|
| BF16 | 16.00 | 34.8 GB | 32.4 GB |
Verdict
Starcoder2 15B needs less VRAM at BF16 (32.4 GB vs 34.8 GB), so it fits on smaller GPUs. Starcoder is the more widely downloaded of the two.
Frequently Asked Questions
- Which needs less VRAM, Starcoder or Starcoder2 15B?
At BF16, Starcoder needs 34.8 GB and Starcoder2 15B needs 32.4 GB, so Starcoder2 15B is the lighter option to run locally.
- What is the difference between Starcoder and Starcoder2 15B?
Starcoder is a 15.8B model from BigCode (StarCoder family), while Starcoder2 15B is a 16.0B model from BigCode (StarCoder family). Compare their VRAM requirements above to see which fits your GPU or Mac.