litert-community·Gemma

Functiongemma 270M Ft Tiny Garden — Hardware Requirements & GPU Compatibility

Chat

Functiongemma 270M Ft Tiny Garden is a 270M-parameter open language model from litert-community in the Gemma family. At BF16 it needs about 0.59 GB of VRAM — see which GPUs and Macs can run it below.

20 downloads 9 likes

Specifications

Publisher
litert-community
Family
Gemma
Parameters
270M
Release Date
2026-02-25
License
Gemma Terms

Get Started

How Much VRAM Does Functiongemma 270M Ft Tiny Garden Need?

Select a quantization to see compatible GPUs below.

QuantizationBitsVRAM
BF16est.16.000.6 GB

est.= calculated VRAM estimate; no published GGUF file found for that quantization yet. Other rows are verified against real community uploads.

Which GPUs Can Run Functiongemma 270M Ft Tiny Garden?

BF16 · 0.6 GB

Functiongemma 270M Ft Tiny Garden (BF16) requires 0.6 GB of VRAM to load the model weights. For comfortable inference with headroom for KV cache and system overhead, 1+ GB is recommended. 50 GPUs can run it, including NVIDIA GeForce RTX 5090, NVIDIA GeForce RTX 3090 Ti.

Runs great

Plenty of headroom
NVIDIA GeForce RTX 5090~1974 tok/sNVIDIA GeForce RTX 3090 Ti~1111 tok/sNVIDIA GeForce RTX 4090~1111 tok/sNVIDIA GeForce RTX 5080~1058 tok/sNVIDIA GeForce RTX 3090~1031 tok/sNVIDIA GeForce RTX 3080 Ti~1005 tok/sNVIDIA GeForce RTX 5070 Ti~987 tok/sNVIDIA GeForce RTX 5090 Laptop GPU~987 tok/sAMD Radeon RX 7900 XTX~976 tok/sNVIDIA GeForce RTX 3080~838 tok/sAMD Radeon RX 7900 XT~814 tok/sNVIDIA GeForce RTX 4080 SUPER~811 tok/sNVIDIA GeForce RTX 4080~790 tok/sNVIDIA GeForce RTX 4070 Ti SUPER~740 tok/sNVIDIA GeForce RTX 5070~740 tok/sNVIDIA TITAN RTX~740 tok/sNVIDIA GeForce RTX 2080 Ti~679 tok/sNVIDIA GeForce RTX 3070 Ti~670 tok/sAMD Radeon RX 9070~651 tok/sAMD Radeon RX 9070 XT~651 tok/sAMD Radeon RX 7800 XT~635 tok/sNVIDIA GeForce RTX 4090 Laptop GPU~635 tok/sAMD Radeon RX 7900 GRE~586 tok/sNVIDIA GeForce RTX 4070~555 tok/sNVIDIA GeForce RTX 4070 SUPER~555 tok/sNVIDIA GeForce RTX 4070 Ti~555 tok/sNVIDIA GeForce GTX 1080 Ti~534 tok/sAMD Radeon RX 6800~521 tok/sAMD Radeon RX 6800 XT~521 tok/sAMD Radeon RX 6900 XT~521 tok/sNVIDIA GeForce RTX 3060 Ti~494 tok/sNVIDIA GeForce RTX 3070~494 tok/sNVIDIA GeForce RTX 5060~494 tok/sNVIDIA GeForce RTX 5060 Ti 16GB~494 tok/sNVIDIA GeForce RTX 5060 Ti 8GB~494 tok/sIntel Arc A770 16GB~475 tok/sAMD Radeon RX 7700 XT~439 tok/sIntel Arc A750~434 tok/sNVIDIA GeForce RTX 3060 12GB~397 tok/sAMD Radeon RX 6700 XT~391 tok/sIntel Arc B580~386 tok/sAMD Radeon RX 9060 XT 16GB~325 tok/sIntel Arc B570~322 tok/sNVIDIA GeForce RTX 4060 Ti 16GB~317 tok/sNVIDIA GeForce RTX 4060 Ti 8GB~317 tok/sNVIDIA GeForce RTX 4060~300 tok/sAMD Radeon RX 7600~293 tok/sAMD Radeon RX 7600 XT~293 tok/sNVIDIA GeForce RTX 3060 8GB~264 tok/sNVIDIA GeForce RTX 3050 8GB~247 tok/s

Which Devices Can Run Functiongemma 270M Ft Tiny Garden?

BF16 · 0.6 GB

59 devices with unified memory can run Functiongemma 270M Ft Tiny Garden, including NVIDIA DGX H100, NVIDIA DGX A100 640GB.

Runs great

Plenty of headroom
NVIDIA DGX H100~29525 tok/sNVIDIA DGX A100 640GB~17971 tok/sMac Studio (M3 Ultra, 256GB)~972 tok/sMac Studio (M3 Ultra, 512GB)~972 tok/sMac Studio (M3 Ultra, 96GB)~972 tok/sMac Pro M2 Ultra (192 GB)~949 tok/sMac Studio M2 Ultra (192 GB)~949 tok/sMacBook Pro 16" M5 Max (128 GB)~729 tok/sMac Studio M4 Max (128 GB)~648 tok/sMac Studio M4 Max (64 GB)~648 tok/sMacBook Pro 16" M4 Max (48 GB)~648 tok/sMacBook Pro 16" M4 Max (64 GB)~648 tok/sMac Studio M4 Max (36 GB)~486 tok/sMacBook Pro 14" M4 Max (36 GB)~486 tok/sMacBook Pro 16" M3 Max (48 GB)~486 tok/sMacBook Pro 14-inch (M5 Pro)~364 tok/sMac Mini M4 Pro (24 GB)~324 tok/sMac Mini M4 Pro (48 GB)~324 tok/sMacBook Pro 14" M4 Pro (24 GB)~324 tok/sMacBook Pro 16" M4 Pro (24 GB)~324 tok/sASUS Ascent GX10~301 tok/sNVIDIA DGX Spark~301 tok/sNVIDIA Jetson AGX Thor Developer Kit~301 tok/sAsus ROG Flow Z13 (2025, Ryzen AI Max+ 395, 128 GB)~282 tok/sBeelink GTR9 Pro (Ryzen AI Max+ 395, 128 GB)~282 tok/sFramework Desktop (Ryzen AI Max+ 395, 128 GB)~282 tok/sGMKtec EVO-X2 (Ryzen AI Max+ 395, 128 GB)~282 tok/sHP Z2 Mini G1a (Ryzen AI Max+ PRO 395, 128 GB)~282 tok/sHP ZBook Ultra G1a 14 (Ryzen AI Max+ PRO 395, 128 GB)~282 tok/sMinisforum MS-S1 MAX (Ryzen AI Max+ 395, 128 GB)~282 tok/sSnapdragon X2 Elite Extreme Copilot+ PC~251 tok/sNVIDIA Jetson AGX Orin 32GB~226 tok/sNVIDIA Jetson AGX Orin 64GB~226 tok/sMacBook Pro 14-inch (M5)~182 tok/siPad Pro M5 13" (16 GB)~182 tok/sSnapdragon X Elite Copilot+ PC~149 tok/sMac Mini M4 (16 GB)~142 tok/sMac Mini M4 (32 GB)~142 tok/sMacBook Air 13" M4 (16 GB)~142 tok/sMacBook Air 13" M4 (24 GB)~142 tok/sMacBook Air 15" M4 (16 GB)~142 tok/sMacBook Air 15" M4 (24 GB)~142 tok/sMacBook Pro 14" M4 (16 GB)~142 tok/siPad Pro M4 13" (16 GB)~142 tok/sAMD Ryzen AI 9 HX 370 (Strix Point) Laptop~122 tok/sMacBook Air 13" M3 (16 GB)~122 tok/sMacBook Air 13" M3 (24 GB)~122 tok/sMacBook Air 13" M3 (8 GB)~122 tok/sIntel Core Ultra 9 288V (Lunar Lake) Laptop~116 tok/sNVIDIA Jetson Orin NX 16GB~113 tok/sNVIDIA Jetson Orin Nano 8GB (Super)~112 tok/sApple iPhone 17 Pro~91 tok/siPhone 17 Pro Max~91 tok/siPhone 17~81 tok/siPhone Air~81 tok/siPhone 15 ProiPhone 15 Pro MaxiPhone 16 ProiPhone 16 Pro Max

Related Models

Frequently Asked Questions

How much VRAM does Functiongemma 270M Ft Tiny Garden need?

Functiongemma 270M Ft Tiny Garden requires 0.6 GB of VRAM at BF16.

VRAM = Weights + KV Cache + Overhead

Weights = 270M × 16 bits ÷ 8 = 0.5 GB

KV Cache + Overhead 0.1 GB (at 2K context + ~0.3 GB framework)

VRAM usage by quantization

0.6 GB

Learn more about VRAM estimation →

Can I run Functiongemma 270M Ft Tiny Garden on a Mac?

Functiongemma 270M Ft Tiny Garden requires at least 0.6 GB at BF16, which exceeds the unified memory of most consumer Macs. You would need a Mac Studio or Mac Pro with a high-memory configuration.

Can I run Functiongemma 270M Ft Tiny Garden locally?

Yes — Functiongemma 270M Ft Tiny Garden can run locally on consumer hardware. At BF16 quantization it needs 0.6 GB of VRAM. Popular tools include Ollama, LM Studio, and llama.cpp.

How fast is Functiongemma 270M Ft Tiny Garden?

At BF16, Functiongemma 270M Ft Tiny Garden can reach ~8136 tok/s on AMD Instinct MI350X. On NVIDIA GeForce RTX 4090: ~1111 tok/s. Speed depends mainly on GPU memory bandwidth. Real-world results typically within ±20%.

tok/s = (bandwidth GB/s ÷ model GB) × efficiency

Example: NVIDIA B2008000 ÷ 0.6 × 0.65 = ~8814 tok/s

Estimated speed at BF16 (0.6 GB)

~8814 tok/s
~1111 tok/s
~8814 tok/s
~8136 tok/s

Real-world results typically within ±20%. Speed depends on batch size, quantization kernel, and software stack.

Learn more about tok/s estimation →

What's the download size of Functiongemma 270M Ft Tiny Garden?

At BF16, the download is about 0.54 GB.

Which GPUs can run Functiongemma 270M Ft Tiny Garden?

50 consumer GPUs can run Functiongemma 270M Ft Tiny Garden at BF16 (0.6 GB). Top options include AMD Radeon RX 6700 XT, AMD Radeon RX 6800, AMD Radeon RX 6800 XT. 50 GPUs have plenty of headroom for comfortable inference.

Which devices can run Functiongemma 270M Ft Tiny Garden?

59 devices with unified memory can run Functiongemma 270M Ft Tiny Garden at BF16 (0.6 GB), including AMD Ryzen AI 9 HX 370 (Strix Point) Laptop, ASUS Ascent GX10, Apple iPhone 17 Pro, Asus ROG Flow Z13 (2025, Ryzen AI Max+ 395, 128 GB). Apple Silicon Macs use unified memory shared between CPU and GPU, making them well-suited for local LLM inference.