llmrun

Intel · Xe2 (Battlemage), BMG-G21 · 16 GB VRAM tier

Best AI Models for Intel Arc Pro B50 (16 GB)

Runs 7–9B models well; 14B fits but is slow (12 tok/s).

16 GB GDDR6224 GB/s85 TFLOPS FP1670 WXe2 (Battlemage), BMG-G21 2025

Low-power 16 GB SFF card (70 W) — modest 224 GB/s bandwidth caps throughput; best for compact, quiet inference rigs.

What LLMs can the Arc Pro B50 run?

#ModelSpeedllmrun ScoreQuant · VRAM
1
Q4_K_M · 6.6 GB · 17.6 t/s
17.6 tok/sQ4_K_M · 6.6 GB
2
Qwen3.5 4BAlibaba
Q4_K_M · 3.4 GB · 34.4 t/s
34.4 tok/sQ4_K_M · 3.4 GB
3
Q4_K_M · 13.1 GB · 35.8 t/s
35.8 tok/sQ4_K_M · 13.1 GB
4
Q4_K_M · 7.3 GB · 18.4 t/s
18.4 tok/sQ4_K_M · 7.3 GB
5
Ling 3.0 TinyInclusion AI
Q4_K_M · 5.5 GB · 76.1 t/s
76.1 tok/sQ4_K_M · 5.5 GB
See all 307 models on the Arc Pro B50 →Best quant that fits · speeds estimated on this card

About the Arc Pro B50

The Arc Pro B50 runs 7–9B models well. Xe2 (Battlemage), BMG-G21 generation, released 2025.

GenerationXe2 (Battlemage), BMG-G21released 2025

Arc Pro B50 strengths and weaknesses

Strengths

  • Runs 35B MoE models: Qwen3.6 35B A3B at 37.8 tok/s in 15.7 GB
  • Low power draw: 70 W board power; a 150 W PSU is enough

Weaknesses

  • 70B models don't fit: Llama 3.3 70B Instruct needs 51.3 GB at Q4 vs 16 GB here
  • Slow on large dense models: Qwen3.8 27B at 7.5 tok/s
  • Slow prompt reading: A 4K-token prompt on Qwen3.5 9B waits 5.2 s for the first token
  • oneAPI, not CUDA: No FP8 or NVFP4 weights and no vLLM AWQ or GPTQ; use GGUF builds

Arc Pro B50 tokens per second by model size

Output speed depends on memory bandwidth (224 GB/s). Grey rows need more than 16 GB.

  1. 9BQwen3.5 9B · Q4_K_M · 6.6 GB
    17.6tok/s
  2. 14BQwen3 14B · Q4_K_M · 11.9 GB
    11.8tok/s
  3. 27–31BQwen3.8 27B · Q3_K_L · 15.4 GB tight · Q3_K_L
    7.5tok/s
  4. 35B MoEQwen3.6 35B A3B · IQ3_S · 15.7 GB tight · IQ3_S
    37.8tok/s
  5. 70BLlama 3.3 70B Instruct · not at 4-bit
    needs 51.3 GB
  6. 120B MoEGPT OSS 120B · not at 4-bit
    needs 70.8 GB

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 1057 models on the Arc Pro B50

Featured only

Best quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with Intel Arc Pro B50 — ranked by Score, recency and Fit
ModelVRAMScoreFit
Q4_K_M·11200.0 t/s
0.2 GBS100, Runs great
Opt 6.7B
FP16·7.6 t/s
14.7 GBD27, Barely runs
Granite 3.1 8B Instruct
Q4_K_M·20.2 t/s
7.9 GBB60, Decent
Q4_K_M·42.3 t/s
4.8 GBA76, Runs well
Q4_K_M·32.9 t/s
9.0 GBA72, Runs well
Darwin 36B Opus
Q2_K·46.6 t/s
15.2 GBB55, Decent
Q4_K_M·37.7 t/s
3.2 GBA74, Runs well
Gemma 4 31B
IQ3_XS·7.7 t/s
15.8 GBD15, Barely runs
IQ2_XXS·43.2 t/s
13.8 GBA69, Runs well
Yi 6B
Q4_K_M·27.5 t/s
4.2 GBA68, Runs well
Q2_K·37.8 t/s
15.7 GBC44, Usable
SmolLM 135M
Q4_K_M·260.5 t/s
0.4 GBS100, Runs great
Q4_K_M·22.4 t/s
5.8 GBB62, Decent
Q3_K_M·8.1 t/s
14.3 GBC33, Usable
Q4_K_M·12.3 t/s
12.0 GBB51, Decent

Arc Pro B50 specs, power and PSU

Specs

Architecture
Xe2 (Battlemage), BMG-G21
VRAM
16 GB GDDR6
Memory bandwidth
224.0 GB/s
FP16 (dense)
85.00 TFLOPS
Tensor cores
128
TDP
70 W
Released
2025-09-03
MSRP
$349

Arc Pro B50 FAQ

What is the largest model the Arc Pro B50 can run?

Gemma 4 26B A4B IT (25.8B) is the largest at 4-bit or better: at Q4_K_S it uses 15.5 GB of 16 GB, and runs at about 34.4 tok/s. At 3-bit, a bigger model fits too: Gemma 2 27B IT (27.2B) at IQ3_M, 15.0 GB.

Can the Arc Pro B50 run Qwen3.5 9B?

Yes. Qwen3.5 9B fits at Q4_K_M, using 6.6 GB of 16 GB, and it is the best model that runs well on this card.

Can the Arc Pro B50 run 70B models?

No. Llama 3.3 70B Instruct needs 51.3 GB at Q4, more than the 16 GB on this card.

How many tokens per second does the Arc Pro B50 give?

About 17.6 tok/s on Qwen3.5 9B at Q4_K_M, with the first token after 5.2 s on a 4K-token prompt.

What power supply does the Arc Pro B50 need?

Plan a 150 W PSU (2× the 70 W TDP).

Is 16 GB enough for coding and agents?

Yes for coding: GPT OSS 20B, the best of the 2 coding models that fit, runs at about 36 tok/s. For agents, not yet: no agent-scored model fits in less than 96 GB.