llmrun

Ornith Models — Hardware Requirements

11 Ornith models from Deep Reinforce and the community, from the smallest that runs in 6.2 GB of VRAM at Q4 up to 403.4B parameters. Every row links to full quantization tables and GPU compatibility.

All Ornith Models by Size

ModelParamsContext
Ornith 1.0 9B9.4B262K
Ornith 1.5 9B9.7B262K
Ornith 1.0 35B35.1B262K
Ornith 1.5 35B A3B36.0B262K
Ornith 1.0 397B396.8B262K
Ornith 1.5 397B403.4B262K
Community variants and fine-tunes (8)
ModelParamsContext
Cyber Ornith 1.5 9B OBLITERATED9.0B262K
Huihui Ornith 1.5 9B Abliterated9.4B262K
Ornith 1.5 9B OBLITERATED9.7B262K
Ornith 1.5 35B A3B REAP 50 NVFP4A1618.5B262K
Unsloth Ornith 1.5 35B A3B35B—
Ornith 1.0 35B AEON Ultimate Uncensored BF1635.1B262K
Ornith 1.0 35B Uncensored Heretic35.1B262K
Huihui Ornith 1.5 35B A3B Abliterated36.0B262K

Frequently Asked Questions

How much VRAM do I need to run a Ornith model?
The smallest Ornith model, Cyber Ornith 1.5 9B OBLITERATED, runs from 6.2 GB of VRAM at Q4_K_M (smaller low-bit quantizations start at 3.0 GB with a noticeable quality loss). Larger family members need proportionally more — see the table above for every model.
Which Ornith models can I run on a 16 GB GPU?
6 of 14 Ornith models fit in 16 GB of VRAM at Q4_K_M, including Cyber Ornith 1.5 9B OBLITERATED, Ornith 1.0 9B, Ornith 1.5 9B.
What is the most popular Ornith model to run locally?
Cyber Ornith 1.5 9B OBLITERATED is the most downloaded Ornith model in local-friendly quantized formats. It runs from 6.2 GB of VRAM at Q4_K_M.