Macs for Running LLMs Locally

Which Mac Can Run an LLM?

Apple Silicon Macs use unified memory shared between CPU and GPU, so the memory you buy is the memory a model can use. A 24 GB Mac runs 27B models at Q4, and a 128 GB Mac Studio loads 100B+ mixture-of-experts models; memory bandwidth (Pro, Max, Ultra chips) sets the speed.