Nemotron Models — Hardware Requirements
30 Nemotron models from NVIDIA and the community, from the smallest that runs in 1.0 GB of VRAM up to 560.5B parameters. Every row links to full quantization tables and GPU compatibility.
All Nemotron Models by Size
Frequently Asked Questions
- How much VRAM do I need to run a Nemotron model?
- The smallest Nemotron model, OpenMath Nemotron 1.5B, runs from 1.0 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which Nemotron models can I run on a 16 GB GPU?
- 22 of 34 Nemotron models fit in 16 GB of VRAM at some quantization, including NVIDIA Nemotron 3 Nano 30B A3B BF16, Nemotron 3 Nano Omni 30B A3B Reasoning BF16, NVIDIA Nemotron Nano 9B v2 Japanese.
- What is the most popular Nemotron model to run locally?
- NVIDIA Nemotron 3 Nano 30B A3B BF16 is the most downloaded Nemotron model in local-friendly quantized formats. It runs from 9.1 GB of VRAM.