llmrun
AppleM1 UltraDesktop

Best AI Models for Mac Studio M1 Ultra (128 GB)

Memory:128 GB UnifiedBandwidth:800.0 GB/sGPU Cores:48 GPU coresCPU Cores:20 CPU coresNeural Engine:22.0 TOPS

128 GB unified − 3.5 GB OS overhead = 124.5 GB available for AI models

How does this device compare with your machine?

230 of 367 featured models run great on Mac Studio M1 Ultra (128 GB) · best pick: Qwen3.8 27B at ~32.1 tok/s

largest that fits: 235.7B (Qwen3 VL 235B A22B Instruct, Q4_0) · 405B needs Q2 or offload

What LLMs Can Mac Studio M1 Ultra (128 GB) Run?

1228 models · 878 run great · 236 run well

Score: model quality, 100 = average model. Fit: how well it runs on this hardware, S best to F won't fit. Ordered by quality, recency and Fit. How ranking works

Showing compatibility for Mac Studio M1 Ultra (128 GB)

LLM models compatible with Mac Studio M1 Ultra (128 GB) — ranked by quality, recency and Fit
ModelVRAMScoreFit
Granite Vision 4.1 4B
4.0B·Q4_K_M·195.1 t/s·131K ctx
4.0 GBS100, Runs great
Laguna XS.2
33.4B·Q4_K_M·88.5 t/s·262K ctx
21.3 GBS89, Runs great
Seed OSS 36B Instruct
36.2B·Q4_K_M·25.2 t/s·524K ctx
24.1 GBA66, Runs well
27.8B·Q4_K_M·32.1 t/s·262K ctx
17.9 GBA71, Runs well
FrogNano 4B 2609
4.7B·Q4_K_M·171.8 t/s·262K ctx
3.4 GBS98, Runs great
24.0B·Q4_K_M·37.0 t/s·131K ctx
18.1 GBA74, Runs well
MiniCPM V 4.6 Thinking
1.3B·Q4_K_M·495.6 t/s·262K ctx
1.5 GBS100, Runs great
D1 3B
3.1B·Q4_K_M·243.5 t/s·33K ctx
2.6 GBS100, Runs great
21.2B·Q4_K_M·102.3 t/s·131K ctx
13.6 GBS92, Runs great
DeepSeek R1 Distill Qwen 32B
32.8B·Q4_K_M·27.3 t/s·131K ctx
24.3 GBA68, Runs well
35.1B·Q4_K_M·81.6 t/s·262K ctx
21.5 GBS88, Runs great
Granite 4.2 8B
8.8B·Q4_K_M·94.8 t/s·131K ctx
8.3 GBS90, Runs great
Ling 3.0 Flash VL
124.8B·Q4_K_M·67.3 t/s·131K ctx
76 GBS85, Runs great
304.2B·Q2_K_S·35.5 t/s·1049K ctx
122.2 GBC44, Usable
2.5B·BF16·101.8 t/s·500K ctx
7.1 GBS92, Runs great
34.7B·Q4_K_M·85.0 t/s·262K ctx
21.3 GBS88, Runs great

Mac Studio M1 Ultra (128 GB) has 124.5 GB of memory for models. In the ranking below, Qwen3.8 27B leads at Q4_K_M: it needs 17.9 GB (14% of that memory) and generates about 32.1 tokens per second. 230 of the 367 featured models earn a Fit S here, meaning they load with room for context and run fast. Decode speed is set mostly by memory bandwidth (800 GB/s), so smaller and mixture-of-experts models are noticeably quicker than dense models of the same quality. 405B-class models need about 257 GB at Q4_K_M, more than the 124.5 GB available; they fit only at Q2 with a quality loss, or by offloading layers to system RAM.

Runs Well

  • Qwen3.8 27B (27.8B at Q4_K_M, ~32.1 tok/s)
  • Gemma 4 26B A4B IT (25.8B at Q4_K_M, ~91.7 tok/s)
  • Muse Glimmer 30B (29.8B at Q4_K_M, ~30.5 tok/s)
  • Gemma 4 31B IT (31.3B at Q4_K_M, ~27.5 tok/s)
  • NVIDIA Nemotron 3.5 Lightning 30B A3B BF16 (31.6B at Q4_K_M, ~77 tok/s)

Challenging

  • Inkling Small (266.0B at IQ3_S, ~103 tok/s) fits but uses 93% of memory, so keep context short
  • MiniMax M2.7 (228.7B at Q3_K_L, ~44.4 tok/s) fits but uses 96% of memory, so keep context short
  • Qwen3.8 Flash Next (180.0B at Q4_K_M, ~13.2 tok/s) fits but uses 88% of memory, so keep context short
  • 405B-class models need ~257 GB at Q4_K_M, so only Q2 fits

Mac Studio M1 Ultra (128 GB) Specifications

Brand
Apple
Chip
M1 Ultra
Type
Desktop
Unified Memory
128 GB
Memory Bandwidth
800.0 GB/s
GPU Cores
48
CPU Cores
20
Neural Engine
22.0 TOPS
Release Date
2022-03-18

Get Started

Ollama (Recommended)

Runs Qwen3.8 27B on Q4_K_M; this is our top choice here.

$curl -fsSL https://ollama.com/install.sh | sh
$ollama run hf.co/unsloth/Qwen3.8-27B-GGUF:Q4_K_M

LM Studio

LM Studio

Download LM Studio, search for "Qwen3.8 27B", and run it with one click.

Prompt Processing

Estimated for Qwen3.8 27B, the compute-bound phase that reads your prompt before the first reply token appears.

112.3tok/s prefill

Short chat

4.6 s

512 tok prompt

Long chat

36.5 s

4,096 tok prompt

Document / codebase

292 s

32,768 tok prompt

Prefill is compute-bound and a different number from the decode tok/s shown elsewhere on this page — how prompt processing works →

Performance figures are estimates calibrated as of 2026-09-21 — see calibration basis →

What to do next with Mac Studio M1 Ultra (128 GB)

Which model to run first, a faster option with the same memory, and what more memory unlocks. Computed from the rankings and specs above.

Frequently Asked Questions

Can Mac Studio M1 Ultra (128 GB) run Qwen3.8 27B?

Yes. The Mac Studio M1 Ultra (128 GB) with 128 GB unified memory can run Qwen3.8 27B (Q4_K_M, 17.9 GB, 14% of memory). It is also the table's best pick, at ~32.1 tok/s. 230 of the 367 featured models get a Fit of S (runs great) here. The largest featured model that fits at Q4 or better is Qwen3 VL 235B A22B Instruct (235.7B at Q4_0). 405B-class models need about 257 GB at Q4_K_M, so only Q2 (with a quality loss) or CPU offload gets them running in 124.5 GB. Check the compatibility table above for the full list with Fit, VRAM usage and estimated speed. Models are checked against the 124.5 GB available to AI (that is, the 128 GB of RAM minus roughly 3.5 GB for macOS), while Apple Silicon's unified memory allows the GPU to draw from that same pool without copying data.

How much memory is available for AI on Mac Studio M1 Ultra (128 GB)?

The Mac Studio M1 Ultra (128 GB) has 128 GB unified memory. After macOS reserves ~3.5 GB for the operating system, approximately 124.5 GB is available for AI models. Model rankings here use that 124.5 GB limit instead of the total 128 GB. Unlike discrete GPUs where VRAM is separate from system RAM, a unified-memory device shares one memory pool between the CPU and GPU — this means no data copying overhead, but you share memory with macOS and open apps.

Is Mac Studio M1 Ultra (128 GB) good for AI?

With 128 GB unified memory and 800.0 GB/s bandwidth, the Mac Studio M1 Ultra (128 GB) is excellent for running local AI models. Models that run well include Gemma 4 26B A4B IT (25.8B at Q4_K_M, ~91.7 tok/s); Muse Glimmer 30B (29.8B at Q4_K_M, ~30.5 tok/s); Gemma 4 31B IT (31.3B at Q4_K_M, ~27.5 tok/s). This is a premium configuration, with room for large models at good quality and most smaller ones at maximum quality.

What's the best model for Mac Studio M1 Ultra (128 GB)?

For the Mac Studio M1 Ultra (128 GB), the best pick right now is Qwen3.8 27B at ~32.1 tok/s. Also running well: Gemma 4 26B A4B IT (25.8B at Q4_K_M, ~91.7 tok/s); Muse Glimmer 30B (29.8B at Q4_K_M, ~30.5 tok/s); Gemma 4 31B IT (31.3B at Q4_K_M, ~27.5 tok/s). The best choice depends on your use case: coding assistants benefit from code-tuned models, general chat from instruction-tuned ones. The list is ranked by quality, recency and Fit.

How fast is Mac Studio M1 Ultra (128 GB) for AI inference?

With 800.0 GB/s memory bandwidth, the Mac Studio M1 Ultra (128 GB) achieves approximately 124 tok/s on a 7B model at Q4_K_M — that's very fast, well above conversational speed. A 14B model runs at ~62 tok/s. In the ranking, the top pick Qwen3.8 27B runs at ~32.1 tok/s. Apple Silicon achieves high efficiency (~70%) thanks to unified memory — there's no PCIe bottleneck between CPU and GPU.

= (800 GB/s ÷ model GB) × efficiency

Apple Silicon achieves ~70% bandwidth efficiency thanks to and Metal acceleration.

Estimated speed on Mac Studio M1 Ultra (128 GB)

~32 tok/s
~92 tok/s
~31 tok/s
~28 tok/s

Real-world results typically within ±20%.

Learn more about tok/s estimation →

Can I run AI offline on Mac Studio M1 Ultra (128 GB)?

Yes — once you download a model, it runs entirely on the Mac Studio M1 Ultra (128 GB) without internet. Applications like Ollama and LM Studio make it straightforward to download, manage, and run models locally. All your conversations stay private on your device with zero data sent to external servers. This is one of the key advantages of local AI: complete privacy, no API costs, and no rate limits.