llmrun

Intel · Core Ultra 5 226V · Laptop

Best AI Models for Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop

Runs 9B models at 11 tok/s; 14B only just fits in 11 GB, and 27–31B doesn't fit.

16 GB unified11 GB for models136.5 GB/s27 TFLOPS FP1617 W2024

What LLMs can the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop run?

#ModelSpeedllmrun ScoreQuant · Memory
1
Q4_K_M · 6.6 GB · 10.7 t/s
10.7 tok/sQ4_K_M · 6.6 GB
2
Qwen3.5 4BAlibaba
Q4_K_M · 3.4 GB · 20.9 t/s
20.9 tok/sQ4_K_M · 3.4 GB
3
Q4_K_M · 5.0 GB · 24.0 t/s
24.0 tok/sQ4_K_M · 5.0 GB
4
Ling 3.0 TinyInclusion AI
Q4_K_M · 5.5 GB · 54.1 t/s
54.1 tok/sQ4_K_M · 5.5 GB
5
Q4_K_M · 3.5 GB · 19.9 t/s
19.9 tok/sQ4_K_M · 3.5 GB

About the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop

The Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop is a mid-range 16 GB laptop: it runs 9B models at 11 tok/s. The system keeps about 5 GB, leaving 11 GB for models. With 27 TFLOPS it reads long prompts faster than most 16 GB machines: a 4K-token prompt takes 17 s. Core Ultra 5 226V, released 2024.

Speed in 16 GB#5137 GB/s
Prompt reading#127 TFLOPS
For models11 GBThe system keeps 5 GB
ChipCore Ultra 5 226Vreleased 2024

Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop strengths and weaknesses

Strengths

  • Low power draw: 17 W at full load for the whole machine

Weaknesses

  • 27–31B models don't fit: Qwen3.8 27B needs 17.9 GB at Q4 vs 11 GB usable here
  • Little room for context: Qwen3 14B uses 10.9 of 11 GB usable, 0.1 GB left
  • Slow prompt reading: A 32K-token prompt on Qwen3.5 9B waits 2.2 min for the first token
  • oneAPI, not CUDA: No FP8 or NVFP4 weights and no vLLM AWQ or GPTQ; use GGUF builds

Memory for models

11 GB of 16 GB
9B6.6 GB14B10.9 GB
9B6.6 GB14B10.9 GB
For models 11 GBThe system keeps 5 GBModel size at Q4

27–31B models need 17.9 GB at Q4, more than the 11 GB available.Or rent an RTX 3090 (24 GB) from $0.18/hr →

Similar devices and alternatives

The same chip from other makers first, then machines and GPUs people weigh against it, each with the one reason it is worth a look. Speeds on Qwen3.5 9B.

Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop tokens per second by model size

Output speed depends on memory bandwidth (137 GB/s). Grey rows need more than the 11 GB available.

  1. 9BQwen3.5 9B · Q4_K_M · 6.6 GB
    10.7tok/s
  2. 14BQwen3 14B · IQ4_XS · 10.9 GB tight · IQ4_XS
    8.0tok/s
  3. 27–31BQwen3.8 27B · not at 4-bit
    needs 17.9 GB
  4. 35B MoEQwen3.6 35B A3B · not at 4-bit
    needs 22.0 GB
  5. 70BLlama 3.3 70B Instruct · not at 4-bit
    needs 51.3 GB
  6. 120B MoEGPT OSS 120B · not at 4-bit
    needs 70.8 GB

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 956 models on the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop

Featured only

Best quant that fits in 11 GB, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop — ranked by Score, recency and Fit
ModelVRAMScoreFit
Pythia 6.9B
Q4_K_M·14.8 t/s
4.6 GBB55, Decent
Q4_K_M·13.9 t/s
6.8 GBB53, Decent
Phi 4 Mini Reasoning
Q4_K_M·23.8 t/s
4.8 GBB64, Decent
Q4_K_M·46.7 t/s
1.7 GBA78, Runs well
DeepSeek R1 Distill Qwen 7B
Q4_K_M·13.7 t/s
5.8 GBB53, Decent
Qwen2.5 Coder 14B Instruct
Q4_0·8.4 t/s
10.9 GBD16, Barely runs
Q4_K_M·12.7 t/s
6.2 GBB51, Decent
Qwen3 Coder 30B A3B Instruct
IQ2_S·39.1 t/s
10.6 GBB48, Decent
Q4_K_M·379.2 t/s
1.2 GBS100, Runs great
GPT OSS 20B Heretic
Q3_K_M·27.9 t/s
10.8 GBC41, Usable
Q4_K_M·12.7 t/s
6.2 GBB51, Decent
Q4_K_M·67.6 t/s
1.0 GBS85, Runs great
Arete 27B
IQ2_M·6.8 t/s
10.4 GBD21, Barely runs
Q4_K_M·40.6 t/s
2.1 GBA75, Runs well
Q4_K_M·98.4 t/s
2.0 GBS91, Runs great

Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop specs and power

Specs

Chip
Core Ultra 5 226V · Intel Arc 130V
CPU cores
8
GPU cores
7
Unified memory
16 GB LPDDR5X-8533 (on-package)
For models
11 GB (The system keeps 5 GB)
Memory bandwidth
136.5 GB/s
FP16 (dense)
26.5 TFLOPS
NPU
Intel AI Boost NPU 4 (40 TOPS)
Power
17 W max
Released
2024-09-24

Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop FAQ

How much memory is available for AI on the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop?

About 11 GB of the 16 GB. The system keeps roughly 5 GB for itself and other apps.

What is the largest model the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop can run?

Phi 4 (14.7B) is the largest at 4-bit or better: at Q4_0 it uses 11.0 GB, 100% of the available memory, and runs at about 8.5 tok/s.

Can the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop run Qwen3.5 9B?

Yes. Qwen3.5 9B fits at Q4_K_M, using 6.6 GB of the 11 GB available, and it is the best model that runs well on this machine.

Can the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop run 27–31B models?

No. Qwen3.8 27B needs 17.9 GB at Q4, more than the 11 GB available.

How long does the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop take to read a long prompt?

On Qwen3.5 9B, about 17 s for a 4K-token prompt and 2.2 min for a 32K-token document before the first word appears.

Is renting a GPU cheaper than buying the Intel Core Ultra 5 226V (Lunar Lake, 16 GB) Laptop?

An RTX 3090 (24 GB) rents from $0.14/hr.