DeepSeek R1 Distill Qwen 32B vs DeepSeek R1 Distill Qwen 32B Abliterated
Side-by-side comparison of VRAM requirements, quantization, context length, and hardware compatibility.
Specifications
| DeepSeek R1 Distill Qwen 32B | DeepSeek R1 Distill Qwen 32B Abliterated | |
|---|---|---|
| Parameters | 32.8B | 32.8B |
| Context | 131K | 131K |
| Architecture | Qwen2ForCausalLM | Qwen2ForCausalLM |
| License | MIT | — |
| Downloads | 561.6K | 5.3K |
| Released | — | Feb 2025 |
VRAM by Quantization: DeepSeek R1 Distill Qwen 32B vs DeepSeek R1 Distill Qwen 32B Abliterated
| Quantization | Bits | DeepSeek R1 Distill Qwen 32B VRAM | DeepSeek R1 Distill Qwen 32B Abliterated VRAM |
|---|---|---|---|
| Q2_K | 3.40 | 14.8 GB | 14.8 GB |
| Q3_K_M | 3.90 | 16.8 GB | 16.8 GB |
| Q3_K_S | 3.50 | 15.2 GB | 15.2 GB |
| Q4_0 | 4.00 | 17.2 GB | 17.2 GB |
| Q4_K_M | 4.80 | 20.5 GB | 20.5 GB |
| Q5_K_M | 5.70 | 24.2 GB | 24.2 GB |
| Q6_K | 6.60 | 27.9 GB | 27.9 GB |
| Q8_0 | 8.00 | 33.6 GB | 33.6 GB |
Verdict
DeepSeek R1 Distill Qwen 32B is the more widely downloaded of the two.
Frequently Asked Questions
- Which needs less VRAM, DeepSeek R1 Distill Qwen 32B or DeepSeek R1 Distill Qwen 32B Abliterated?
At Q4_K_M, DeepSeek R1 Distill Qwen 32B needs 20.5 GB and DeepSeek R1 Distill Qwen 32B Abliterated needs 20.5 GB, so DeepSeek R1 Distill Qwen 32B is the lighter option to run locally.
- Which has a longer context window, DeepSeek R1 Distill Qwen 32B or DeepSeek R1 Distill Qwen 32B Abliterated?
DeepSeek R1 Distill Qwen 32B supports 131,072 tokens and DeepSeek R1 Distill Qwen 32B Abliterated supports 131,072 tokens.
- What is the difference between DeepSeek R1 Distill Qwen 32B and DeepSeek R1 Distill Qwen 32B Abliterated?
DeepSeek R1 Distill Qwen 32B is a 32.8B model from DeepSeek (Qwen family), while DeepSeek R1 Distill Qwen 32B Abliterated is a 32.8B model from huihui-ai (Qwen family). Compare their VRAM requirements above to see which fits your GPU or Mac.