llmrun

Apple · M4 · Tablet

Best AI Models for iPad Pro M4 13" (16 GB)

Runs 9B models at 13 tok/s; 14B only just fits in 12.5 GB, and 27–31B doesn't fit.

16 GB unified12.5 GB for models120 GB/s9 TFLOPS FP162024

What LLMs can the iPad Pro M4 13" run?

#ModelSpeedllmrun ScoreQuant · Memory
1
Q4_K_M · 6.6 GB · 13.2 t/s
13.2 tok/sQ4_K_M · 6.6 GB
2
Qwen3.5 4BAlibaba
Q4_K_M · 3.4 GB · 25.8 t/s
25.8 tok/sQ4_K_M · 3.4 GB
3
Q4_K_M · 5.0 GB · 29.6 t/s
29.6 tok/sQ4_K_M · 5.0 GB
4
Q4_K_M · 7.9 GB · 15.8 t/s
15.8 tok/sQ4_K_M · 7.9 GB
5
Ling 3.0 TinyInclusion AI
Q4_K_M · 5.5 GB · 62.8 t/s
62.8 tok/sQ4_K_M · 5.5 GB
See all 281 models on the iPad Pro M4 13" →Bars = traction for models without a Score yet

About the iPad Pro M4 13" (16 GB)

The iPad Pro M4 13" is a mid-range 16 GB tablet: it runs 9B models at 13 tok/s. Among 16 GB machines, only the M1 Pro, M2 Pro and M5 write faster. iPadOS keeps about 3.5 GB, leaving 12.5 GB for models. Prompt reading is its weak spot: a 4K-token prompt waits 46 s before the first word on Qwen3.5 9B. M4 generation, released 2024; the newer M5 writes 27% faster with 1.9× the compute.

Speed in 16 GB#4120 GB/s
Prompt reading#59 TFLOPS
For models12.5 GBiPadOS keeps 3.5 GB
ChipM4released 2024

iPad Pro M4 13" strengths and weaknesses

Weaknesses

  • 27–31B models don't fit: Qwen3.8 27B needs 17.9 GB at Q4 vs 12.5 GB usable here
  • Little room for context: Qwen3 14B uses 11.9 of 12.5 GB usable, 0.6 GB left
  • Slow prompt reading: A 32K-token prompt on Qwen3.5 9B waits 6.1 min for the first token
  • No CUDA: vLLM, AWQ, GPTQ and FP8 builds don't run; use GGUF or MLX

Memory for models

12.5 GB of 16 GB
9B6.6 GB14B11.9 GB
9B6.6 GB14B11.9 GB
For models 12.5 GBiPadOS keeps 3.5 GBModel size at Q4

27–31B models need 17.9 GB at Q4, more than the 12.5 GB available.Or rent an RTX 3090 (24 GB) from $0.19/hr →

Similar devices and alternatives

Other memory sizes of the same machine first, then machines and GPUs people weigh against it, each with the one reason it is worth a look. Speeds on Qwen3.5 9B.

iPad Pro M4 13" tokens per second by model size

Output speed depends on memory bandwidth (120 GB/s). Grey rows need more than the 12.5 GB available.

  1. 9BQwen3.5 9B · Q4_K_M · 6.6 GB
    13.2tok/s
  2. 14BQwen3 14B · Q4_K_M · 11.9 GB tight · Q4_K_M
    8.8tok/s
  3. 27–31BQwen3.8 27B · not at 4-bit
    needs 17.9 GB
  4. 35B MoEQwen3.6 35B A3B · not at 4-bit
    needs 22.0 GB
  5. 70BLlama 3.3 70B Instruct · not at 4-bit
    needs 51.3 GB
  6. 120B MoEGPT OSS 120B · not at 4-bit
    needs 70.8 GB

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

Chip generations: writing vs compute

M1 → M5
Writing speed (tok/s)Compute (TFLOPS FP16)
1×2×3×4×M12021M22023M32024M42024M52025M1 · 5.2 TFLOPS FP16M1 · 7.5 tok/s · 68.3 GB/sM2 · 7.2 TFLOPS FP16M2 · 11.0 tok/s · 100 GB/sM3 · 7 TFLOPS FP16M3 · 11.3 tok/s · 102.4 GB/sM4 · 8.6 TFLOPS FP16M4 · 13.2 tok/s · 120 GB/sM5 · 16 TFLOPS FP16M5 · 16.8 tok/s · 153 GB/sCompute 3.1×Writing +124%
1×2×3×4×M12021M22023M32024M42024M52025M1 · 5.2 TFLOPS FP16M1 · 7.5 tok/s · 68.3 GB/sM2 · 7.2 TFLOPS FP16M2 · 11.0 tok/s · 100 GB/sM3 · 7 TFLOPS FP16M3 · 11.3 tok/s · 102.4 GB/sM4 · 8.6 TFLOPS FP16M4 · 13.2 tok/s · 120 GB/sM5 · 16 TFLOPS FP16M5 · 16.8 tok/s · 153 GB/sCompute 3.1×Writing +124%

Writing speed follows memory bandwidth and barely moved: 7.5 to 16.8 tok/s since the M1. Compute, which sets how fast prompts are read, grew 3.1×. Indexed to the M1; speeds on Qwen3.5 9B, same 16 GB.

All 971 models on the iPad Pro M4 13"

Featured only

Best quant that fits in 12.5 GB, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with iPad Pro M4 13" (16 GB) — ranked by Score, recency and Fit
ModelVRAMScoreFit
LFM2 1.2B
Q4_K_M·78.5 t/s
1.2 GBS87, Runs great
Q4_K_M·15.6 t/s
6.2 GBB55, Decent
Q4_K_M·17.6 t/s
6.7 GBB57, Decent
Q4_K_M·14.1 t/s
8.6 GBB53, Decent
Starcoder2 3B
Q4_K_M·38.5 t/s
2.6 GBA75, Runs well
Q4_K_M·15.6 t/s
6.2 GBB55, Decent
Q2_K·46.2 t/s
11.5 GBB60, Decent
Qwen3 VL 30B A3B Instruct
IQ2_M·38.7 t/s
11.6 GBB55, Decent
Q4_K_M·144.8 t/s
0.8 GBS96, Runs great
NuExtract
Q4_K_M·24.7 t/s
4.2 GBA65, Runs well
Phonellm Alpha 1
IQ2_M·39.5 t/s
11.0 GBB64, Decent
NVIDIA Nemotron Nano 12B v2
Q4_K_M·10.3 t/s
11.0 GBC38, Usable
Q4_K_M·17.1 t/s
5.7 GBB57, Decent
Q4_K_M·9.8 t/s
8.6 GBB48, Decent
Q4_K_M·15.6 t/s
6.2 GBB55, Decent

iPad Pro M4 13" specs

Specs

Chip
M4
CPU cores
10
GPU cores
10
Unified memory
16 GB
For models
12.5 GB (iPadOS keeps 3.5 GB)
Memory bandwidth
120 GB/s
FP16 (dense)
8.6 TFLOPS
Neural Engine
38 TOPS
Released
2024-05-15

iPad Pro M4 13" FAQ

How much memory is available for AI on the iPad Pro M4 13" (16 GB)?

About 12.5 GB of the 16 GB. iPadOS keeps roughly 3.5 GB for itself and other apps.

What is the largest model the iPad Pro M4 13" (16 GB) can run?

GPT OSS 20B (20.9B) is the largest at 4-bit or better: at Q4_K_S it uses 12.4 GB, 99% of the available memory, and runs at about 29.6 tok/s.

Can the iPad Pro M4 13" (16 GB) run Qwen3.5 9B?

Yes. Qwen3.5 9B fits at Q4_K_M, using 6.6 GB of the 12.5 GB available, and it is the best model that runs well on this machine.

Can the iPad Pro M4 13" (16 GB) run 27–31B models?

No. Qwen3.8 27B needs 17.9 GB at Q4, more than the 12.5 GB available.

How long does the iPad Pro M4 13" (16 GB) take to read a long prompt?

On Qwen3.5 9B, about 46 s for a 4K-token prompt and 6.1 min for a 32K-token document before the first word appears.