Best AI Models for iMac 24" M4 (24 GB)
24 GB unified − 3.5 GB OS overhead = 20.5 GB available for AI models
How does this device compare with your machine?
42 of 293 featured models run great on iMac 24" M4 (24 GB) · best pick: Qwen3.8 27B at ~4.8 tok/s
largest that fits: 36.0B (Qwen3.6 35B A3B, IQ4_XS) · 70B needs CPU offload or more memory
What LLMs Can iMac 24" M4 (24 GB) Run?
1068 models · 262 run great · 240 run well
Score: model quality, 100 = average model. Fit: how well it runs on this hardware, S best to F won't fit. Ordered by quality, recency and Fit. How ranking works
Showing compatibility for iMac 24" M4 (24 GB)
| Model | Quant | VRAM | Speed | Context | Score | Fit |
|---|---|---|---|---|---|---|
Gemma4 12B QAT Uncensored HauhauCS BalancedVisionRoleplayChat | Q4_K_M | 10.8 GB | 10.6 t/s | — | B49, Decent | |
Laguna XS.2ChatFunctions | Q3_K_M | 17.5 GB | 38.5 t/s | 262K | A68, Runs well | |
| Q4_K_M | 18.1 GB | 5.6 t/s | 131K | C32, Usable | ||
Molmo2 8BVision | Q4_K_M | 7.9 GB | 14.5 t/s | 37K | B54, Decent | |
Phi 4ChatMathCode | Q4_K_M | 12.5 GB | 8.8 t/s | 16K | B47, Decent | |
Olmo 3 7B InstructChatFunctions | Q4_K_M | 8.4 GB | 14.6 t/s | 66K | B54, Decent | |
Nandi Mini 150MChat | BF16 | 0.6 GB | 133.3 t/s | 2K | S95, Runs great | |
Qwen3.5 0.8BVisionFunctions | Q4_K_M | 0.9 GB | 96.6 t/s | 262K | S90, Runs great | |
Tiny Random Qwen3ChatFunctions | Q4_K_M | 0.3 GB | 280.0 t/s | 33K | S100, Runs great | |
Opt 125MChat | BF16 | 0.3 GB | 300.0 t/s | 2K | S100, Runs great | |
Intern Decision 4BVisionFunctions | Q4_K_M | 3.4 GB | 26.3 t/s | 262K | A67, Runs well | |
| Q4_K_M | 0.9 GB | 118.3 t/s | 262K | S95, Runs great | ||
SmolLM3 3BChatFunctions | Q4_K_M | 3.4 GB | 36.5 t/s | 66K | A73, Runs well | |
| Q4_K_M | 1.5 GB | 71.2 t/s | 1049K | S86, Runs great | ||
| Q4_K_M | 0.9 GB | 121.7 t/s | 8K | S95, Runs great | ||
Qwen3.5 27BVisionFunctions | Q4_K_M | 17.9 GB | 4.8 t/s | 262K | C32, Usable |
iMac 24" M4 (24 GB) has 20.5 GB of memory for models. In the ranking below, Qwen3.8 27B leads at Q4_K_M: it needs 17.9 GB (87% of that memory) and generates about 4.8 tokens per second. 42 of the 293 featured models earn a Fit S here, meaning they load with room for context and run fast. Decode speed is set mostly by memory bandwidth (120 GB/s), so smaller and mixture-of-experts models are noticeably quicker than dense models of the same quality. 70B-class models need about 46 GB at Q4_K_M, more than the 20.5 GB available, so they require offloading layers to system RAM or a larger-memory setup.
Runs Well
- Gemma 4 26B A4B IT (25.8B at Q4_K_M, ~25.8 tok/s)
- GPT OSS 20B (20.9B at Q4_K_M, ~28.1 tok/s)
- Qwen3.5 4B (4.7B at Q4_K_M, ~25.8 tok/s)
- Ling 3.0 Tiny (7.9B at Q4_K_M, ~62.8 tok/s)
- MiniCPM5 2B (2.5B at Q4_K_M, ~44.2 tok/s)
Challenging
- Qwen3.8 27B (27.8B at Q4_K_M, ~4.8 tok/s) fits but uses 87% of memory, so keep context short
- Qwen3.6 35B A3B (36.0B at IQ4_XS, ~25.7 tok/s) fits but uses 97% of memory, so keep context short
- Qwen3.5 9B (9.7B at Q4_K_M, ~13.2 tok/s) fits but uses 32% of memory, so keep context short
- 70B-class models need ~46 GB at Q4_K_M, so they need CPU offload or more memory
- 120B-class models need ~77 GB at Q4_K_M, so they need CPU offload or more memory
iMac 24" M4 (24 GB) Specifications
- Brand
- Apple
- Chip
- M4
- Type
- Desktop
- Unified Memory
- 24 GB
- Memory Bandwidth
- 120.0 GB/s
- GPU Cores
- 10
- CPU Cores
- 10
- Neural Engine
- 38.0 TOPS
- Release Date
- 2024-11-08
Get Started
Prompt Processing
Estimated for Qwen3.8 27B, the compute-bound phase that reads your prompt before the first reply token appears.
Short chat
16.5 s
512 tok prompt
Long chat
132 s
4,096 tok prompt
Document / codebase
1057 s
32,768 tok prompt
Prefill is compute-bound and a different number from the decode tok/s shown elsewhere on this page — how prompt processing works →
Performance figures are estimates calibrated as of 2026-09-21 — see calibration basis →
What to do next with iMac 24" M4 (24 GB)
Which model to run first, a faster option with the same memory, and what more memory unlocks. Computed from the rankings and specs above.
Best coding model here
Qwen3.8 27B
27.8B at Q4_K_M
- Coding llmrun Score 112.1
- about 4.8 tokens per second
- 17.9 GB needed at Q4_K_M
Highest coding llmrun Score among official models that fit iMac 24" M4 (24 GB).
Same 24 GB, faster
MacBook Pro 14-inch (M5)
Apple
- 8 GB more memory
- 28% higher memory bandwidth
Higher memory bandwidth means faster token generation.
Bigger models: step up to 32 GB
Mac Mini M4 (32 GB)
Apple
- 8 GB more memory
Unlocks 8 more official models, incl. Mixtral 8x7B Instruct v0.1 (46.7B at IQ4_XS).
Frequently Asked Questions
Can iMac 24" M4 (24 GB) run Qwen3.8 27B?
Yes. The iMac 24" M4 (24 GB) with 24 GB unified memory can run Qwen3.8 27B (Q4_K_M, 17.9 GB, 87% of memory). It is also the table's best pick, at ~4.8 tok/s. 42 of the 293 featured models get a Fit of S (runs great) here. The largest featured model that fits at Q4 or better is Qwen3.6 35B A3B (36.0B at IQ4_XS). 70B-class models need around 46 GB at Q4_K_M, meaning they need CPU offloading or extra memory beyond what's available in 20.5 GB. Check the compatibility table above for the full list with Fit, VRAM usage and estimated speed. Models are checked against the 20.5 GB available to AI (that is, the 24 GB of RAM minus roughly 3.5 GB for macOS), while Apple Silicon's unified memory allows the GPU to draw from that same pool without copying data.
How much memory is available for AI on iMac 24" M4 (24 GB)?
The iMac 24" M4 (24 GB) has 24 GB unified memory. After macOS reserves ~3.5 GB for the operating system, approximately 20.5 GB is available for AI models. Model rankings here use that 20.5 GB limit instead of the total 24 GB. Unlike discrete GPUs where VRAM is separate from system RAM, a unified-memory device shares one memory pool between the CPU and GPU — this means no data copying overhead, but you share memory with macOS and open apps.
Is iMac 24" M4 (24 GB) good for AI?
With 24 GB unified memory and 120.0 GB/s bandwidth, the iMac 24" M4 (24 GB) is solid for running local AI models. Models that run well include Gemma 4 26B A4B IT (25.8B at Q4_K_M, ~25.8 tok/s); GPT OSS 20B (20.9B at Q4_K_M, ~28.1 tok/s); Qwen3.5 4B (4.7B at Q4_K_M, ~25.8 tok/s). Mid-size models run at good quality, and Metal acceleration keeps interactive chat smooth.
What's the best model for iMac 24" M4 (24 GB)?
For the iMac 24" M4 (24 GB), the best pick right now is Qwen3.8 27B at ~4.8 tok/s. Also running well: Gemma 4 26B A4B IT (25.8B at Q4_K_M, ~25.8 tok/s); GPT OSS 20B (20.9B at Q4_K_M, ~28.1 tok/s); Qwen3.5 4B (4.7B at Q4_K_M, ~25.8 tok/s). The best choice depends on your use case: coding assistants benefit from code-tuned models, general chat from instruction-tuned ones. The list is ranked by quality, recency and Fit.
How fast is iMac 24" M4 (24 GB) for AI inference?
With 120.0 GB/s memory bandwidth, the iMac 24" M4 (24 GB) achieves approximately 19 tok/s on a 7B model at Q4_K_M — that's functional for interactive use. A 14B model runs at ~9 tok/s. In the ranking, the top pick Qwen3.8 27B runs at ~4.8 tok/s. Apple Silicon achieves high efficiency (~70%) thanks to unified memory — there's no PCIe bottleneck between CPU and GPU.
Tokens per second (estimate): Our tok/s is the decode speed for one user, estimated from memory bandwidth divided by the model size, times an efficiency factor for the platform. Real results typically land within ±20%. It does not cover prompt processing, which is measured separately as time to first token. Read more = (120 GB/s ÷ model GB) × efficiency
Apple Silicon achieves ~70% bandwidth efficiency thanks to Unified memory: Apple Silicon Macs pool their memory between CPU and GPU. We subtract the 3.5 GB reserved for macOS from the total RAM to find what's available for a model; thus, a 32 GB Mac counts as having 28.5 GB usable. Other unified-memory devices expose a lower fixed limit instead, which we apply. Read more and Metal acceleration.
Estimated speed on iMac 24" M4 (24 GB)
Real-world results typically within ±20%.
Can I run AI offline on iMac 24" M4 (24 GB)?
Yes — once you download a model, it runs entirely on the iMac 24" M4 (24 GB) without internet. Applications like Ollama and LM Studio make it straightforward to download, manage, and run models locally. All your conversations stay private on your device with zero data sent to external servers. This is one of the key advantages of local AI: complete privacy, no API costs, and no rate limits.