All LLM Models
Browse 25 LLM models with VRAM requirements, quantization options, and hardware compatibility.
Understanding LLM VRAM Requirements
How much VRAM you need depends on the model size and quantization level. Quantization reduces the precision of model weights, trading small quality losses for significantly lower VRAM usage. For example, a 7B parameter model needs ~14 GB at FP16 but only ~4 GB at Q4_K_M quantization.
Model List
DeepSeek R1 0528 Qwen3 8B
DeepSeek · 8.2B · runs from 2.9 GB
823.7K
1.1KWith about 8 billion parameters, DeepSeek R1 0528 Qwen3 8B is a dated May 2025 release in DeepSeek's R1 line, built on a Qwen3-based architecture rather than DeepSeek's own base model. It supports explicit step-by-step reasoning, generating intermediate reasoning traces before producing a final answer, which sets it apart from standard instruction-tuned chat models that answer directly. Its modest size means it runs comfortably on modest consumer GPUs, making it accessible for local experimentation with reasoning-style outputs without specialized hardware. It offers a 128K token context window, ample for most reasoning and coding tasks, and is released under the MIT license, allowing broad local and commercial use.
DeepSeek R1 Distill Llama 70B
DeepSeek · 70.6B · runs from 20.4 GB
DeepSeek R1 Distill Llama 70B is the largest model in the R1 distillation lineup, combining the reasoning capabilities developed in the full 684.5B R1 with the robust Llama 3.1 70B architecture. At 70 billion parameters, it delivers the strongest reasoning performance of any dense R1 distill, approaching the full R1's quality on many math and coding benchmarks. Running this model locally requires a multi-GPU setup or a single GPU with very high VRAM capacity, though quantized versions can fit on hardware with 48 GB or more. For users who need top-tier open-weight reasoning and have the hardware to support a 70B dense model, this is one of the strongest options available.
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · 1.8B · runs from 0.8 GB
DeepSeek R1 Distill Qwen 1.5B is the smallest model in the R1 distillation family, packing chain-of-thought reasoning capabilities into just 1.5 billion parameters using the Qwen 2.5 architecture. It represents an ambitious attempt to bring structured reasoning to the smallest practical model size. At this scale, the model can run on virtually any modern GPU and even on CPU-only setups with acceptable speed. While its reasoning depth is naturally limited compared to its larger siblings, it still demonstrates structured thinking patterns that set it apart from generic models of similar size.
DeepSeek R1 Distill Qwen 7B
DeepSeek · 7.6B · runs from 3.0 GB
DeepSeek R1 Distill Qwen 7B compresses the reasoning techniques from DeepSeek's full R1 model into a compact 7.6 billion parameter dense model built on the Qwen 2.5 architecture. Despite its small footprint, it demonstrates surprisingly capable step-by-step reasoning on math and logic problems that would stump many models several times its size. This is one of the most accessible reasoning models available for local use, fitting comfortably on GPUs with 6 GB or more of VRAM when quantized. It strikes a practical balance between genuine chain-of-thought reasoning ability and the hardware constraints of a typical consumer setup.
DeepSeek R1 Distill Qwen 32B
DeepSeek · 32.8B · runs from 9.8 GB
DeepSeek R1 Distill Qwen 32B takes the reasoning capabilities developed in the full 684.5B R1 model and distills them into the 32.8 billion parameter Qwen 2.5 architecture. The result is a dense model that punches well above its weight class on math, science, and coding reasoning tasks, often matching models two to three times its size. At around 32.8 billion parameters, this model fits comfortably on a single high-end consumer GPU when quantized to 4-bit precision, making it one of the most capable reasoning models you can run on a desktop workstation.
Deepseek Coder 6.7B Instruct
DeepSeek · 6.7B · runs from 4.2 GB
DeepSeek Coder 6.7B Instruct is a first-generation code-specialized model trained on a large corpus of source code and programming-related data. At 6.7 billion parameters, it provides solid code completion, generation, and explanation capabilities across popular programming languages while remaining small enough to run on most consumer GPUs. While newer models in the DeepSeek lineup have surpassed it in raw capability, this model remains a practical choice for users who need a lightweight local coding assistant with minimal hardware requirements. It runs well on GPUs with as little as 6 GB of VRAM when quantized.
DeepSeek R1 Distill Qwen 14B
DeepSeek · 14.8B · runs from 5.1 GB
DeepSeek R1 Distill Qwen 14B sits in a sweet spot between the smaller 7B distill and the more demanding 32B version, offering strong reasoning performance at 14.8 billion parameters on the Qwen 2.5 architecture. It captures a meaningful share of the full R1's chain-of-thought capabilities while keeping resource requirements within the range of mainstream consumer GPUs. Quantized to 4-bit, it fits comfortably on GPUs with 12 GB of VRAM, delivering reliable step-by-step reasoning for math, logic, and analytical problems.
DeepSeek R1 Distill Llama 8B
DeepSeek · 8.0B · runs from 2.8 GB
DeepSeek R1 Distill Llama 8B brings R1's reinforcement-learned reasoning capabilities to the widely supported Llama 3.1 8B architecture. By distilling the full 684.5B R1 model's reasoning patterns into this 8 billion parameter dense model, DeepSeek created a version that benefits from the extensive Llama ecosystem of tools, quantizations, and inference engines. For users who prefer the Llama architecture or already have tooling built around it, this model offers a plug-and-play path to chain-of-thought reasoning. Its hardware requirements are very approachable, running well on consumer GPUs with 8 GB or more of VRAM at common quantization levels.
Deepseek Coder 6.7B Base
DeepSeek · 6.7B · runs from 3.2 GB
Deepseek Coder 6.7B Base is a 6.7B-parameter open language model from DeepSeek in the DeepSeek Coder family. It supports a context window of up to 16,384 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
Deepseek Coder 33B Instruct
DeepSeek · 33.3B · runs from 14.6 GB
DeepSeek-Coder-33B-Instruct is DeepSeek's 33.3-billion-parameter instruction-tuned code model, initialized from DeepSeek-Coder-33B-Base and further fine-tuned on 2 billion tokens of instruction data for chat-style code generation, completion, and fixing. The underlying Deepseek Coder family was pretrained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese) with project-level context and a fill-in-the-blank training objective, giving it strong project-level completion and infilling ability alongside state-of-the-art open-model results on HumanEval, MBPP, and related coding benchmarks at the time of release. At 33.3 billion parameters, it needs a high-end consumer GPU or a multi-GPU setup once quantized. Context length is 16,384 tokens. Model weights are released under DeepSeek's custom model license, which permits commercial use. It was published in November 2023, alongside 1.3B, 5.7B, and 6.7B siblings and the corresponding base checkpoint.
DeepSeek Coder v2 Lite Instruct
DeepSeek · 15.7B · runs from 7.2 GB
DeepSeek Coder V2 Lite Instruct is a code-focused mixture-of-experts model with 15.7 billion total parameters, trained to handle both programming tasks and general conversation. It supports a wide range of programming languages and excels at code generation, debugging, explanation, and refactoring. The MoE architecture keeps compute costs manageable despite the model's broad capabilities, and the Lite variant is sized to run on a single consumer GPU. For developers looking for a capable local coding assistant that can also handle general chat, this model offers an appealing combination of code specialization and practical hardware requirements.
DeepSeek OCR 2
DeepSeek · 3.4B · runs from 1.9 GB
DeepSeek OCR 2 is DeepSeek's compact vision-language model built for optical character recognition and document understanding, totaling 3.4 billion parameters with about 1.2 billion active per token through its mixture-of-experts design. Only the active parameters compute per token, keeping inference fast, though the full weight set still needs to fit in memory; at this size that's within reach of a consumer GPU or laptop once quantized. It uses a DeepEncoder V2 vision architecture that reasons over document layout semantically instead of scanning images in a fixed pattern. The model has an 8K token context window, suited to single-document OCR passes. It is released under the Apache 2.0 license, allowing unrestricted commercial and research use, and was published in January 2026 as DeepSeek's OCR successor.
Deepseek Coder 33B Base
DeepSeek · 33.3B · runs from 14.6 GB
DeepSeek-Coder-33B-Base is DeepSeek's 33.3-billion-parameter base (pretrained, not instruction-tuned) code model, trained from scratch on 2 trillion tokens (87% code, 13% natural language in English and Chinese) using grouped-query attention, project-level code context, and a fill-in-the-blank training objective for project-level completion and infilling. It is intended as a foundation for further fine-tuning or direct code completion and infilling use, not conversational use; the instruction-tuned DeepSeek-Coder-33B-Instruct is built on top of it. At release, the Deepseek Coder family achieved state-of-the-art open-model results on HumanEval, MultiPL-E, MBPP, DS-1000, and APPS. At 33.3 billion parameters, it needs a high-end consumer GPU or a multi-GPU setup once quantized. Context length is 16,384 tokens. Model weights are released under DeepSeek's custom model license, which permits commercial use. It was published in October 2023, alongside 1.3B, 5.7B, and 6.7B siblings and the corresponding instruct checkpoint.
DeepSeek v2 Lite Chat
DeepSeek · 15.7B · runs from 5.1 GB
DeepSeek v2 Lite Chat is a 15.7B-parameter open language model from DeepSeek in the DeepSeek V2 family. It supports a context window of up to 163,840 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
Deepseek Coder 7B Instruct V1.5
DeepSeek · 6.9B · runs from 4.2 GB
Deepseek Coder 7B Instruct V1.5 is a 6.9-billion-parameter code-focused language model from DeepSeek, fine-tuned from the DeepSeek-LLM 7B base for programming assistance, code generation, and general chat. It continues DeepSeek's original Coder line, trained on roughly 2 trillion tokens of code-heavy text before instruction tuning, and its default system prompt frames it specifically as a programming assistant. Its size makes it well suited to local deployment on a single mainstream consumer GPU with around 8GB or more of VRAM once quantized. Context length is limited to 4,096 tokens, short by current standards. It is released under DeepSeek's own custom license (listed as "Other"), so commercial users should review the license terms before deployment. Published in January 2024, it is one of DeepSeek's earlier widely adopted open-weight coding assistants.
DeepSeek OCR
DeepSeek · 3.3B · runs from 1.8 GB
DeepSeek OCR is a 3.3-billion-parameter vision-language model from DeepSeek, purpose-built for optical character recognition and document parsing rather than general chat. It pairs a vision encoder with a Mixture-of-Experts decoder that activates roughly 1.1 billion parameters per token, keeping decoding fast while all expert weights still need to fit in memory. Its core idea is compressing a page of text into a much smaller set of image tokens before decoding, and it is small enough to run on a single consumer GPU once quantized. Context length is limited to 8,192 tokens, reflecting its page-oriented use case. It is released under the MIT license, a highly permissive option for commercial use, and was published in October 2025, introducing "optical context compression" to shrink the token count needed for OCR.
DeepSeek v2 Lite
DeepSeek · 15.7B · runs from 7.4 GB
DeepSeek V2 Lite is a compact mixture-of-experts model with 15.7 billion total parameters, designed to deliver a strong quality-to-compute ratio for general chat and instruction following. It uses the same innovative MLA (Multi-Head Latent Attention) architecture as the larger V2, which reduces memory requirements during inference. With its modest parameter count, V2 Lite runs comfortably on a single consumer GPU, making it accessible to users who want to try DeepSeek's MoE approach without needing specialized hardware. It handles everyday conversational tasks, summarization, and light analysis well, offering a practical entry point into the DeepSeek model family.
Deepseek Vl2 Tiny
DeepSeek · 3.4B · runs from 7.4 GB
DeepSeek-VL2-Tiny is the smallest in DeepSeek's VL2 series of Mixture-of-Experts vision-language models, with about 3.4 billion total parameters but only roughly 1.2 billion activated per token. It handles vision-language tasks — visual question answering, OCR, document/table/chart understanding, and visual grounding — below the larger VL2-Small and full VL2 variants. Only a fraction of parameters activate per token, so decoding stays fast even though every expert must still be loaded into memory. It is compact enough to run on a single consumer GPU once quantized. Context length is limited to 4,096 tokens. It is released under DeepSeek's own model license, a custom permissive license with an acceptable-use policy rather than a fully open license like MIT or Apache 2.0. Published in December 2024, it pairs a small DeepSeekMoE-3B backbone with a dynamic image-tiling vision encoder.
Deepseek Coder 1.3B Instruct
DeepSeek · 1.3B · runs from 1.3 GB
DeepSeek Coder 1.3B Instruct is an ultra-compact code model designed for environments where hardware resources are extremely limited. Despite having just 1.3 billion parameters, it can handle basic code completion, simple generation tasks, and code Q&A across common programming languages. This is one of the smallest viable code models available, capable of running on integrated graphics or very low-end dedicated GPUs. It is well suited for edge deployment, embedded development environments, or as a fast local autocomplete engine where response speed matters more than handling complex multi-file reasoning tasks.
Deepseek Llm 7B Base
DeepSeek · 7B · runs from 4.3 GB
Deepseek Llm 7B Base is a 7B-parameter open language model from DeepSeek in the DeepSeek family. It supports a context window of up to 4,096 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
Deepseek Moe 16B Base
DeepSeek · 16.4B · runs from 7.7 GB
Deepseek Moe 16B Base is a 16.4B-parameter open language model from DeepSeek in the DeepSeek family. It supports a context window of up to 4,096 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
Deepseek Coder 1.3B Base
DeepSeek · 1.3B · runs from 1.3 GB
Deepseek Coder 1.3B Base is a 1.3B-parameter open language model from DeepSeek in the DeepSeek Coder family. It supports a context window of up to 16,384 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
Deepseek Moe 16B Chat
DeepSeek · 16.4B · runs from 7.7 GB
Deepseek Moe 16B Chat is a 16.4B-parameter open language model from DeepSeek in the DeepSeek family. It supports a context window of up to 4,096 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
Deepseek Llm 7B Chat
DeepSeek · 7B · runs from 4.3 GB
Deepseek Llm 7B Chat is a 7B-parameter open language model from DeepSeek in the DeepSeek family. It supports a context window of up to 4,096 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.
DeepSeek Coder v2 Lite Base
DeepSeek · 15.7B · runs from 7.4 GB
DeepSeek Coder v2 Lite Base is a 15.7B-parameter open language model from DeepSeek in the DeepSeek Coder family. It supports a context window of up to 163,840 tokens. See its VRAM requirements by quantization and which GPUs and Macs can run it locally below.