Starcoder2 15B vs Starcoderbase 1B
Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.
Specifications
| Starcoder2 15B | Starcoderbase 1B | |
|---|---|---|
| Parameters | 16.0B | 1.1B |
| Context | 16K | — |
| Architecture | Starcoder2ForCausalLM | — |
| License | bigcode-openrail-m | bigcode-openrail-m |
| Downloads | 8.4K | 2.9K |
| Released | Jun 2024 | Sep 2023 |
VRAM by Quantization: Starcoder2 15B vs Starcoderbase 1B
| Quantization | Bits | Starcoder2 15B VRAM | Starcoderbase 1B VRAM |
|---|---|---|---|
| BF16 | 16.00 | 32.4 GB | 2.5 GB |
Verdict
Starcoderbase 1B needs less VRAM at BF16 (2.5 GB vs 32.4 GB), so it fits on smaller GPUs. Starcoder2 15B is the more widely downloaded of the two.
Frequently Asked Questions
- Which needs less VRAM, Starcoder2 15B or Starcoderbase 1B?
At BF16, Starcoder2 15B needs 32.4 GB and Starcoderbase 1B needs 2.5 GB, so Starcoderbase 1B is the lighter option to run locally.
- What is the difference between Starcoder2 15B and Starcoderbase 1B?
Starcoder2 15B is a 16.0B model from BigCode (StarCoder family), while Starcoderbase 1B is a 1.1B model from BigCode (StarCoder family). Compare their VRAM requirements above to see which fits your GPU or Mac.