Falcon Models — Hardware Requirements
13 Falcon models from TII UAE and the community, from the smallest that runs in 0.0 GB of VRAM up to 41.8B parameters. Every row links to full quantization tables and GPU compatibility.
All Falcon Models by Size
| Model | Params | Runs from | Context | Publisher | Quant downloads |
|---|---|---|---|---|---|
| Falcon Mamba Tiny Dev | 9M | 0.0 GB | — | ||
| Falcon H1 Tiny 90M Instruct | 91M | 0.4 GB | 262K | ||
| Falcon H1 0.5B Base | 521M | 0.5 GB | 16K | ||
| Falcon H1 0.5B Instruct | 521M | 0.6 GB | 16K | ||
| Falcon 7B | 7.2B | 3.4 GB | — | ||
| Falcon 7B Instruct | 7.2B | 3.4 GB | — | ||
| Falcon Mamba 7B | 7.3B | 2.7 GB | — | ||
| Falcon3 Mamba 7B Base | 7.3B | 16 GB | — | ||
| Falcon H1 7B Base | 7.6B | 3.7 GB | 262K | ||
| Falcon H1 7B Instruct | 7.6B | 2.6 GB | 262K | ||
| Falcon 11B | 11.1B | 5.0 GB | 8K | ||
| Falcon 40B Instruct | 40B | 12.1 GB | — | ||
| Falcon 40B | 41.8B | 19.6 GB | — |
Frequently Asked Questions
- How much VRAM do I need to run a Falcon model?
- The smallest Falcon model, Falcon Mamba Tiny Dev, runs from 0.0 GB of VRAM at an aggressive quantization. Larger family members need proportionally more — see the table above for every model.
- Which Falcon models can I run on a 16 GB GPU?
- 12 of 13 Falcon models fit in 16 GB of VRAM at some quantization, including Falcon 40B Instruct, Falcon H1 7B Instruct, Falcon 11B.
- What is the most popular Falcon model to run locally?
- Falcon 40B Instruct is the most downloaded Falcon model in local-friendly quantized formats. It runs from 12.1 GB of VRAM.