Intel · Core Ultra 9 288V · Laptop
Best AI Models for Intel Core Ultra 9 288V (Lunar Lake) Laptop (32 GB)
Runs 35B MoE models well; 9B, 14B and 27–31B fit but are slow (11, 7 and 4 tok/s), and 70B doesn't fit in 24 GB.
32 GB unified24 GB for models136.5 GB/s34 TFLOPS FP1630 W2024
| # | Model | Speed | llmrun Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.6 35B A3BAlibabaHow to run → Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 2 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 3 | Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | Q4_K_M · 19.4 GB | |
| 4 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 5 | Q4_K_M · 19.3 GB · 31.7 t/s | 31.7 tok/s | Q4_K_M · 19.3 GB |
| # | Model | Speed | Coding Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.6 35B A3BAlibabaHow to run → Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 2 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 3 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 4 | Qwen3 30B A3B Thinking 2507Alibaba Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | overall | Q4_K_M · 19.4 GB |
| 5 | Q4_K_M · 19.3 GB · 31.7 t/s | 31.7 tok/s | Q4_K_M · 19.3 GB |
| # | Model | Speed | Long context Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 2 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 20.9 t/s | 20.9 tok/s | Q4_K_M · 3.4 GB | |
| 3 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 4 | Qwen3.6 35B A3BAlibaba Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 5 | LFM2.5 24B A2BLiquid AI Q4_K_M · 15.0 GB · 33.0 t/s | 33.0 tok/s | Q4_K_M · 15.0 GB |
| # | Model | Speed ↓ | llmrun Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | Q4_K_M · 19.4 GB | |
| 2 | Q4_K_M · 19.3 GB · 31.7 t/s | 31.7 tok/s | Q4_K_M · 19.3 GB | |
| 3 | Qwen3 30B A3B Instruct 2507Alibaba Q4_K_M · 19.4 GB · 25.2 t/s | 25.2 tok/s | Q4_K_M · 19.4 GB | |
| 4 | GPT OSS 20BOpenAI Q4_K_M · 13.1 GB · 23.4 t/s | 23.4 tok/s | Q4_K_M · 13.1 GB | |
| 5 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB |
| # | Model | Speed | Vision Score | Quant · Memory |
|---|---|---|---|---|
| 1 | Qwen3.6 35B A3BAlibabaHow to run → Q4_K_M · 22.0 GB · 19.8 t/s | 19.8 tok/s | Q4_K_M · 22.0 GB | |
| 2 | Gemma 4 26B A4B ITGoogle Q4_K_M · 16.5 GB · 21.6 t/s | 21.6 tok/s | Q4_K_M · 16.5 GB | |
| 3 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 20.9 t/s | 20.9 tok/s | Q4_K_M · 3.4 GB | |
| 4 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 24.0 t/s | 24.0 tok/s | Q4_K_M · 5.0 GB | |
| 5 | MiniCPM V 4.7 35B A3BOpenBMB Q4_K_M · 22.1 GB · 22.8 t/s | 22.8 tok/s | Q4_K_M · 22.1 GB |
See all 327 models on the Intel Core Ultra 9 288V (Lunar Lake) Laptop →Bars = traction for models without a Score yet
The Intel Core Ultra 9 288V (Lunar Lake) Laptop is a 32 GB laptop with more memory than speed: it runs 35B MoE models well. The system keeps about 8 GB, leaving 24 GB for models. With 34 TFLOPS it reads long prompts faster than most 32 GB machines: a 4K-token prompt takes 6.4 s. Core Ultra 9 288V, released 2024.
Speed in 32 GB#7137 GB/s
Prompt reading#134 TFLOPS
For models24 GBThe system keeps 8 GB
ChipCore Ultra 9 288Vreleased 2024
Intel Core Ultra 9 288V (Lunar Lake) Laptop strengths and weaknesses
Strengths
- Runs 35B MoE models: Qwen3.6 35B A3B at 19.8 tok/s in 22 GB
- Low power draw: 30 W at full load for the whole machine
Weaknesses
- 70B models don't fit: Llama 3.3 70B Instruct needs 51.3 GB at Q4 vs 24 GB usable here
- Slow on large dense models: Qwen3.8 27B at 3.9 tok/s
- Slow prompt reading: A 32K-token prompt on Qwen3.6 35B A3B waits 51.0 s for the first token
- oneAPI, not CUDA: No FP8 or NVFP4 weights and no vLLM AWQ or GPTQ; use GGUF builds
Memory for models
24 GB of 32 GB9B6.6 GB14B11.9 GB27–31B17.9 GB35B MoE22 GB
9B6.6 GB14B11.9 GB35B MoE22 GB
For models 24 GBThe system keeps 8 GBModel size at Q4
70B models need 51.3 GB at Q4, more than the 24 GB available.Or rent an H100 (80 GB) from $2.20/hr →
The same chip from other makers first, then machines and GPUs people weigh against it, each with the one reason it is worth a look. Speeds on Qwen3.6 35B A3B.
134% faster, 3.5 GB less memoryMac Mini M4 Pro (24 GB)Apple · 20.5 GB for models · M4 Pro
▲ 134% speed▼ 3.5 GBabout $1,599
30% faster, 3.5 GB less memoryMacBook Air 13" M4 (24 GB)Apple · 20.5 GB for models · M4▲ 30% speed▼ 3.5 GBabout $1,399
44% faster, 4.5 GB more memoryMacBook Pro 14 M5Apple · 28.5 GB for models · M5▲ 44% speed▲ 4.5 GBabout $1,839
179% faster, 8.5 GB more memoryMac Studio M4 Max (36 GB)Apple · 32.5 GB for models · M4 Max▲ 179% speed▲ 8.5 GBabout $2,499
Reads prompts 12× faster, 24 GB for modelsRTX 4090NVIDIA · 24 GB VRAM · GPU▲ 12× prompts▲ 663% speedsame memoryabout $1,599rent $0.34/hr
Reads prompts 16× faster, 32 GB for modelsRTX 5090NVIDIA · 32 GB VRAM · GPU▲ 16× prompts▲ 977% speed▲ 8 GBabout $5,376rent $0.50/hr
Output speed depends on memory bandwidth (137 GB/s). Grey rows need more than the 24 GB available.
- 9BQwen3.5 9B · Q4_K_M · 6.6 GB10.7tok/s
- 7.2tok/s
- 3.9tok/s
- 35B MoEQwen3.6 35B A3B · Q4_K_M · 22.0 GB19.8tok/s
- 70BLlama 3.3 70B Instruct · not at 4-bitneeds 51.3 GB
- 120B MoEGPT OSS 120B · not at 4-bitneeds 70.8 GB
Estimated speeds: Q4_K_M, 4K context, one user. How we estimate
All 1141 models on the Intel Core Ultra 9 288V (Lunar Lake) Laptop
Featured onlyBest quant that fits in 24 GB, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works
| Model | Quant | VRAM | Speed | Context | Score | Fit |
|---|---|---|---|---|---|---|
Gemma4 E4b Claims ComparisonChatFunctions | Q4_K_M | 5.5 GB | 12.9 t/s | 131K | B52, Decent | |
| Q4_K_M | 21.5 GB | 35.7 t/s | 262K | B59, Decent | ||
Gemma 4 31B IT Qat Q4 0 UnquantizedVisionFunctions | Q4_K_M | 21.7 GB | 3.3 t/s | 262K | D26, Barely runs | |
OvisOCR3VisionFunctions | Q4_K_M | 0.9 GB | 79.4 t/s | 262K | S87, Runs great | |
LFM2.5 8B A1B Opus DistilChatReasoning | Q4_K_M | 5.6 GB | 48.1 t/s | 128K | A79, Runs well | |
Dhara 70MChatCode | BF16 | 0.5 GB | 139.3 t/s | 1K | S96, Runs great | |
TLive Omni 4BChatVisionFunctions | BF16 | 13.3 GB | 5.6 t/s | 262K | C42, Usable | |
Qwen AgentWorld 35B A3BChatFunctions | Q4_K_M | 21.3 GB | 25.7 t/s | 262K | B54, Decent | |
| BF16 | 2.7 GB | 28.0 t/s | 41K | A69, Runs well | ||
MiroThinker 1.7 MiniChatFunctions | Q4_K_M | 19.4 GB | 25.2 t/s | 262K | B64, Decent | |
| Q4_K_M | 4 GB | 19.2 t/s | 262K | B59, Decent | ||
SmolVLM2 2.2B InstructVision | Q4_K_M | 2.3 GB | 46.1 t/s | 8K | A78, Runs well | |
Dolphin Mistral 24B Venice EditionChatFunctions | Q4_K_M | 18.1 GB | 4.5 t/s | 131K | C41, Usable | |
MiniCPM V 4Vision | Q4_K_M | 3.1 GB | 24.6 t/s | 33K | A65, Runs well | |
| Q4_K_M | 1.2 GB | 63.8 t/s | 128K | A84, Runs well |
Specs
- Chip
- Core Ultra 9 288V · Intel Arc 140V
- CPU cores
- 8
- GPU cores
- 8
- Unified memory
- 32 GB LPDDR5X-8533 (on-package)
- For models
- 24 GB (The system keeps 8 GB)
- Memory bandwidth
- 136.5 GB/s
- FP16 (dense)
- 33.6 TFLOPS
- NPU
- Intel AI Boost NPU 4 (48 TOPS)
- Power
- 30 W max
- Released
- 2024-09-24
Intel Core Ultra 9 288V (Lunar Lake) Laptop FAQ
How much memory is available for AI on the Intel Core Ultra 9 288V (Lunar Lake) Laptop?
About 24 GB of the 32 GB. The system keeps roughly 8 GB for itself and other apps.
What is the largest model the Intel Core Ultra 9 288V (Lunar Lake) Laptop can run?
Qwen3.6 35B A3B (36.0B) is the largest at 4-bit or better: at Q4_K_M it uses 22.0 GB, 92% of the available memory, and runs at about 19.8 tok/s.
Can the Intel Core Ultra 9 288V (Lunar Lake) Laptop run 70B models?
No. Llama 3.3 70B Instruct needs 51.3 GB at Q4, more than the 24 GB available.
How long does the Intel Core Ultra 9 288V (Lunar Lake) Laptop take to read a long prompt?
On Qwen3.6 35B A3B, about 6.4 s for a 4K-token prompt and 51 s for a 32K-token document before the first word appears.
Is renting a GPU cheaper than buying the Intel Core Ultra 9 288V (Lunar Lake) Laptop?
An RTX 5090 (32 GB) rents from $0.46/hr.