Intel · Core Ultra 9 288V · Laptop
Best AI Models for Intel Core Ultra 9 288V (Lunar Lake) Laptop (32 GB)
Runs 35B MoE models well; 9B, 14B and 27–31B fit but are slow (11, 7 and 4 tok/s), and 70B doesn't fit in 24 GB.
| # | Model | Speed | llmrun Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.6 35B A3BAlibabaHow to run → Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 2 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 3 | Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | Q4_K_M · 19.4 GB | |
| 4 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 5 | Q4_K_M · 19.3 GB · 31.7 t/s | 31.7 tok/s | Q4_K_M · 19.3 GB |
| # | Model | Speed | Coding Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.6 35B A3BAlibabaHow to run → Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 2 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 3 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 4 | Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | overall | Q4_K_M · 19.4 GB |
| 5 | Q4_K_M · 19.3 GB · 31.7 t/s | 31.7 tok/s | Q4_K_M · 19.3 GB |
| # | Model | Speed | Long context Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 2 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 20.9 t/s | 20.9 tok/s | Q4_K_M · 3.4 GB | |
| 3 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 4 | Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 5 | LFM2.5 24B A2BLiquid AI Q4_K_M · 15.0 GB · 33.0 t/s | 33.0 tok/s | Q4_K_M · 15.0 GB |
| # | Model | Speed ↓ | llmrun Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | Q4_K_M · 19.4 GB | |
| 2 | Q4_K_M · 19.3 GB · 31.7 t/s | 31.7 tok/s | Q4_K_M · 19.3 GB | |
| 3 | Qwen3 30B A3B Instruct 2507Alibaba Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | Q4_K_M · 19.4 GB | |
| 4 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 5 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB |
| # | Model | Speed | Vision Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.6 35B A3BAlibabaHow to run → Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 2 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 3 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 20.9 t/s | 20.9 tok/s | Q4_K_M · 3.4 GB | |
| 4 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 24.0 t/s | 24.0 tok/s | Q4_K_M · 5.0 GB | |
| 5 | MiniCPM V 4.7 35B A3BOpenBMB Q4_K_M · 22.1 GB · 22.8 t/s | 22.8 tok/s | Q4_K_M · 22.1 GB |
The Intel Core Ultra 9 288V (Lunar Lake) Laptop is a 32 GB laptop with more memory than speed: it runs 35B MoE models well. The system keeps about 8 GB, leaving 24 GB for models. With 34 TFLOPS it reads long prompts faster than most 32 GB machines: a 4K-token prompt takes 6.4 s. Core Ultra 9 288V, released 2024.
Intel Core Ultra 9 288V (Lunar Lake) Laptop strengths and weaknesses
Strengths
- Runs 35B MoE models: Qwen3.6 35B A3B at 19.8 tok/s in 22 GB
- Low power draw: 30 W at full load for the whole machine
Weaknesses
- 70B models don't fit: Llama 3.3 70B Instruct needs 51.3 GB at Q4 vs 24 GB usable here
- Slow on large dense models: Qwen3.8 27B at 3.9 tok/s
- Slow prompt reading: A 32K-token prompt on Qwen3.6 35B A3B waits 51.0 s for the first token
- oneAPI, not CUDA: No FP8 or NVFP4 weights and no vLLM AWQ or GPTQ; use GGUF builds
Memory for models
24 GB of 32 GB70B models need 51.3 GB at Q4, more than the 24 GB available.Or rent an H100 (80 GB) from $2.69/hr →
The same chip from other makers first, then machines and GPUs people weigh against it, each with the one reason it is worth a look. Speeds on Qwen3.6 35B A3B.
Output speed depends on memory bandwidth (137 GB/s). Grey rows need more than the 24 GB available.
- 9BQwen3.5 9B · Q4_K_M · 6.6 GB10.7tok/s
- 7.2tok/s
- 3.9tok/s
- 35B MoEQwen3.6 35B A3B · Q4_K_M · 22.0 GB19.8tok/s
- 70BLlama 3.3 70B Instruct · not at 4-bitneeds 51.3 GB
- 120B MoEGPT OSS 120B · not at 4-bitneeds 70.8 GB
Estimated speeds: Q4_K_M, 4K context, one user. How we estimate
All 1141 models on the Intel Core Ultra 9 288V (Lunar Lake) Laptop
Featured onlyBest quant that fits in 24 GB, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works
| Model | Quant | VRAM | Speed | Context | Score | Fit |
|---|---|---|---|---|---|---|
Kumru 2BChat | Q4_K_M | 2.2 GB | 37.1 t/s | 8K | A74, Runs well | |
| Q4_K_M | 7.3 GB | 12.6 t/s | 66K | B51, Decent | ||
Ouro 2.6B ThinkingChatReasoning | BF16 | 12.1 GB | 10.6 t/s | 66K | B49, Decent | |
Gemma4 E4B MiniFantasy V1ChatRoleplay | BF16 | 16.8 GB | 4.1 t/s | 131K | C40, Usable | |
| BF16 | 5.0 GB | 13.8 t/s | 262K | B53, Decent | ||
LightOnOCR 3 4BVisionFunctions | Q4_K_M | 3.4 GB | 21.4 t/s | 262K | B62, Decent | |
CAT Thinking 8BChat | Q4_K_M | 7.6 GB | 12.4 t/s | 41K | B51, Decent | |
MIST Mini 8B ThinkingChatReasoning | Q4_K_M | 7.3 GB | 12.7 t/s | 131K | B51, Decent | |
Depguard Jev Style 1.5BChatFunctions | Q4_K_M | 1.7 GB | 53.3 t/s | 33K | A81, Runs well | |
Helium 1 2BChat | Q4_K_M | 2.0 GB | 39.0 t/s | 4K | A75, Runs well | |
| Q4_K_M | 10.1 GB | 30.3 t/s | 8K | A71, Runs well | ||
Stories15M MOEChat | Q4_K_M | 0.3 GB | 196.4 t/s | 0K | S100, Runs great | |
Mailguard Jev Style 1.5BChatFunctions | Q4_K_M | 1.7 GB | 53.3 t/s | 33K | A81, Runs well | |
| Q4_K_M | 20.6 GB | 3.3 t/s | 1049K | C32, Usable | ||
| Q4_K_M | 2.8 GB | 60.9 t/s | — | A84, Runs well |
Specs
- Chip
- Core Ultra 9 288V · Intel Arc 140V
- CPU cores
- 8
- GPU cores
- 8
- Unified memory
- 32 GB LPDDR5X-8533 (on-package)
- For models
- 24 GB (The system keeps 8 GB)
- Memory bandwidth
- 136.5 GB/s
- FP16 (dense)
- 33.6 TFLOPS
- NPU
- Intel AI Boost NPU 4 (48 TOPS)
- Power
- 30 W max
- Released
- 2024-09-24
Intel Core Ultra 9 288V (Lunar Lake) Laptop FAQ
How much memory is available for AI on the Intel Core Ultra 9 288V (Lunar Lake) Laptop?
About 24 GB of the 32 GB. The system keeps roughly 8 GB for itself and other apps.
What is the largest model the Intel Core Ultra 9 288V (Lunar Lake) Laptop can run?
Qwen3.6 35B A3B (36.0B) is the largest at 4-bit or better: at Q4_K_M it uses 22.0 GB, 92% of the available memory, and runs at about 19.8 tok/s.
Can the Intel Core Ultra 9 288V (Lunar Lake) Laptop run 70B models?
No. Llama 3.3 70B Instruct needs 51.3 GB at Q4, more than the 24 GB available.
How long does the Intel Core Ultra 9 288V (Lunar Lake) Laptop take to read a long prompt?
On Qwen3.6 35B A3B, about 6.4 s for a 4K-token prompt and 51 s for a 32K-token document before the first word appears.
Is renting a GPU cheaper than buying the Intel Core Ultra 9 288V (Lunar Lake) Laptop?
An RTX 5090 (32 GB) rents from $0.50/hr.