Apple · A19 Pro · Phone
Best AI Models for Apple iPhone 17 Pro (12 GB)
Runs 1–4B models well; 8–9B only just fit in the 7 GB iOS gives one app.
| # | Model | Speed | llmrun Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 16.5 t/s | 16.5 tok/s | Q4_K_M · 3.4 GB | |
| 2 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 18.9 t/s | 18.9 tok/s | Q4_K_M · 5.0 GB | |
| 3 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 45.1 t/s | 45.1 tok/s | Q4_K_M · 5.5 GB | |
| 4 | Gemma 4 E2B ITGoogle Q4_K_M · 3.5 GB · 15.7 t/s | 15.7 tok/s | Q4_K_M · 3.5 GB | |
| 5 | Qwen3.5 2BAlibaba Q4_K_M · 1.9 GB · 30.4 t/s | 30.4 tok/s | Q4_K_M · 1.9 GB |
| # | Model | Speed | Reasoning Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Q4_K_M · 5.0 GB · 18.9 t/s | 18.9 tok/s | Q4_K_M · 5.0 GB | |
| 2 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 16.5 t/s | 16.5 tok/s | overall | Q4_K_M · 3.4 GB |
| 3 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 45.1 t/s | 45.1 tok/s | Q4_K_M · 5.5 GB | |
| 4 | Gemma 4 E2B ITGoogle Q4_K_M · 3.5 GB · 15.7 t/s | 15.7 tok/s | Q4_K_M · 3.5 GB | |
| 5 | Qwen3.5 2BAlibaba Q4_K_M · 1.9 GB · 30.4 t/s | 30.4 tok/s | Q4_K_M · 1.9 GB |
| # | Model | Speed | Long context Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 16.5 t/s | 16.5 tok/s | Q4_K_M · 3.4 GB | |
| 2 | Gemma 4 E2B ITGoogle Q4_K_M · 3.5 GB · 15.7 t/s | 15.7 tok/s | Q4_K_M · 3.5 GB | |
| 3 | Qwen3.5 2BAlibaba Q4_K_M · 1.9 GB · 30.4 t/s | 30.4 tok/s | Q4_K_M · 1.9 GB | |
| 4 | MiniCPM5 2BOpenBMB Q4_K_M · 2.5 GB · 28.3 t/s | 28.3 tok/s | Q4_K_M · 2.5 GB | |
| 5 | Spark X2.6 4BXHToken Q4_K_M · 4.3 GB · 18.2 t/s | 18.2 tok/s | Q4_K_M · 4.3 GB |
| # | Model | Speed ↓ | llmrun Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 16.5 t/s | 16.5 tok/s | Q4_K_M · 3.4 GB | |
| 2 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 45.1 t/s | 45.1 tok/s | Q4_K_M · 5.5 GB | |
| 3 | Qwen3.5 2BAlibaba Q4_K_M · 1.9 GB · 30.4 t/s | 30.4 tok/s | Q4_K_M · 1.9 GB | |
| 4 | MiniCPM5 2BOpenBMB Q4_K_M · 2.5 GB · 28.3 t/s | 28.3 tok/s | Q4_K_M · 2.5 GB | |
| 5 | Gemma 4 E2B ITGoogle Q4_K_M · 3.5 GB · 15.7 t/s | 15.7 tok/s | Q4_K_M · 3.5 GB |
| # | Model | Speed | Vision Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 16.5 t/s | 16.5 tok/s | Q4_K_M · 3.4 GB | |
| 2 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 18.9 t/s | 18.9 tok/s | Q4_K_M · 5.0 GB | |
| 3 | Qwen3.5 2BAlibaba Q4_K_M · 1.9 GB · 30.4 t/s | 30.4 tok/s | Q4_K_M · 1.9 GB | |
| 4 | MiniCPM V 4.7 1BOpenBMB Q4_K_M · 1.6 GB · 42.0 t/s | 42.0 tok/s | Q4_K_M · 1.6 GB | |
| 5 | LFM3 Omni 2BLiquid AI Q4_K_M · 2.4 GB · 31.6 t/s | 31.6 tok/s | Q4_K_M · 2.4 GB |
The Apple iPhone 17 Pro suits smaller models: it runs 1–4B models well. iOS lets one app use about 7 GB of the 12 GB, so 8–9B models barely fit. Prompt reading is its weak spot: a 4K-token prompt waits 21 s before the first word on Qwen3.5 4B. A19 Pro chip, released 2025.
Apple iPhone 17 Pro strengths and weaknesses
Strengths
- Runs 3–4B models: Qwen3.5 4B at 16.5 tok/s in 3.4 GB
Weaknesses
- 14B models don't fit: Qwen3 14B needs 11.9 GB at Q4 vs 7 GB usable here
- Little room for context: Qwen3.5 9B uses 6.6 of 7 GB usable, 0.4 GB left
- Slow prompt reading: A 32K-token prompt on Qwen3.5 4B waits 2.8 min for the first token
Memory for models
7 GB of 12 GB14B models need 11.9 GB at Q4, more than the 7 GB available.
How much memory iOS lets one app use decides what phone works for local AI, not the camera or the screen.
Phones run small models. Output speed follows memory bandwidth (76.8 GB/s); grey rows need more than the 7 GB iOS gives one app.
- 1BLlama 3.2 1B Instruct · Q4_K_M · 2.3 GB65.6tok/s
- 3–4BQwen3.5 4B · Q4_K_M · 3.4 GB16.5tok/s
- 8.5tok/s
- 14BQwen3 14B · not at 4-bitneeds 11.9 GB
Estimated speeds: Q4_K_M, 4K context, one user. How we estimate
iPhone generations: memory one app can use
A17 Pro → A19 Pro- iPhone 15 ProA17 Pro · 20234.5 GBup to 4B
- iPhone 16 Pro MaxA18 Pro · 20244.5 GBup to 4B
- iPhone 17A19 · 20255 GBup to 4B
- iPhone 17 ProA19 Pro · 20257 GBup to 9B (tight)
Every phone here has 8 GB or more, but iOS caps one app well below that. The iPhone 17 Pro is the first to fit an 8–9B model.
All 783 models on the Apple iPhone 17 Pro
Featured onlyBest quant that fits in 7 GB, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works
| Model | Quant | VRAM | Speed | Context | Score | Fit |
|---|---|---|---|---|---|---|
Hermes 3 Llama 3.1 8BChatRoleplayFunctions | Q4_K_S | 7.0 GB | 10.6 t/s | 131K | D17, Barely runs | |
Gpt2 XlChat | Q4_K_M | 1.1 GB | 50.7 t/s | 1K | A80, Runs well | |
Mamba 2.8B HFChat | Q4_K_M | 3.7 GB | 29.4 t/s | — | A70, Runs well | |
H2ovl Mississippi 2BChatVision | BF16 | 6.5 GB | 11.3 t/s | — | C31, Usable | |
Phi 1 5ChatCode | Q4_K_M | 0.9 GB | 57.2 t/s | 2K | A82, Runs well | |
Granite 3.0 1B A400m InstructChatFunctions | Q4_K_M | 1.3 GB | 83.5 t/s | 4K | S88, Runs great | |
| Q4_K_M | 1.9 GB | 29.2 t/s | 8K | A70, Runs well | ||
Qwen3 Code Reasoning 4BChatCodeReasoning | Q4_K_M | 4.2 GB | 18.6 t/s | 262K | B58, Decent | |
| Q4_K_M | 1.2 GB | 77.9 t/s | 16K | S87, Runs great | ||
| Q4_K_M | 6.0 GB | 10.3 t/s | 8K | C41, Usable | ||
| Q4_K_M | 1.5 GB | 34.9 t/s | 2K | A73, Runs well | ||
| Q4_K_M | 0.4 GB | 145.3 t/s | 1K | S97, Runs great | ||
Yi 1.5 6B ChatChat | Q4_K_M | 4.2 GB | 13.2 t/s | 4K | B52, Decent | |
OlmOCR 2 7B 1025Vision | Q4_K_M | 6.2 GB | 10.0 t/s | 128K | C36, Usable | |
| Q4_K_M | 4.5 GB | 17.1 t/s | 33K | B57, Decent |
Specs
- Chip
- A19 Pro
- CPU cores
- 6 (2P+4E)
- GPU cores
- 6
- Unified memory
- 12 GB LPDDR5X-9600
- For models
- 7 GB (iOS keeps 5 GB)
- Memory bandwidth
- 76.8 GB/s
- FP16 (dense)
- 9 TFLOPS
- NPU
- 16-core Neural Engine
- Released
- 2025-09-19
Apple iPhone 17 Pro FAQ
Can the Apple iPhone 17 Pro run an LLM offline?
Yes, small ones. Qwen3.5 4B runs at about 16.5 tok/s, and 1B models run around 66 tok/s. iOS lets one app use about 7 GB of the 12 GB, so larger models don't fit.
How much memory is available for AI on the Apple iPhone 17 Pro?
About 7 GB of the 12 GB. iOS keeps roughly 5 GB for itself and other apps.
What is the largest model the Apple iPhone 17 Pro can run?
Qwen3.5 9B (9.7B) is the largest at 4-bit or better: at Q4_K_M it uses 6.6 GB, 95% of the available memory, and runs at about 8.5 tok/s.
How long does the Apple iPhone 17 Pro take to read a long prompt?
On Qwen3.5 4B, about 21 s for a 4K-token prompt and 2.8 min for a 32K-token document before the first word appears.