llmrun

NVIDIA · Pascal · 8 GB VRAM tier

Best AI Models for NVIDIA GeForce GTX 1070 Ti (8 GB)

Runs 7–9B models well; 14B doesn't fit in 8 GB.

8 GB GDDR5256 GB/s8 TFLOPS FP16180 WPascal 2017
Buyabout $449

8 GB at 256 GB/s: fits ~7-8B at Q4. Pascal: no Tensor Cores and very slow FP16, so it runs GGUF (llama.cpp, Ollama) fine but not FP16 runtimes like vLLM; current CUDA 13 builds dropped Pascal — use CUDA 12 or Vulkan builds.

What LLMs can the GTX 1070 Ti run?

#ModelSpeedllmrun ScoreQuant · VRAM
1
Qwen3.5 9BAlibabaHow to run →
Q4_K_M · 6.6 GB · 26.2 t/s
26.2 tok/sQ4_K_M · 6.6 GB
2
Qwen3.5 4BAlibaba
Q4_K_M · 3.4 GB · 51.0 t/s
51.0 tok/sQ4_K_M · 3.4 GB
3
Gemma 2 9B ITGoogle
Q4_K_M · 7.3 GB · 27.3 t/s
27.3 tok/sQ4_K_M · 7.3 GB
4
Gemma 3 4B ITGoogle
Q4_K_M · 5.0 GB · 58.6 t/s
58.6 tok/sQ4_K_M · 5.0 GB
5
Ling 3.0 TinyInclusion AI
Q4_K_M · 5.5 GB · 144 t/s
144 tok/sQ4_K_M · 5.5 GB
See all 218 models on the GTX 1070 Ti →Best quant that fits · speeds estimated on this card

About the GTX 1070 Ti

The GTX 1070 Ti is an entry card in the 8 GB class: it runs 7–9B models well. It is power-hungry for its speed, and the best speed per dollar of the cards compared at ≈$105 used. Pascal generation, released 2017.

Speed in 8 GB#16256 GB/s
Per watt#190.15 tok/s per W on Qwen3.5 9B (9B params)
Per dollar#125.0 tok/s per $100 on Qwen3.5 9B (9B params)
GenerationPascalreleased 2017

GTX 1070 Ti strengths and weaknesses

Strengths

  • Runs 7–9B models: Qwen3.5 9B at 26.2 tok/s in 6.6 GB

Weaknesses

  • 14B models don't fit: Qwen3 14B needs 11.9 GB at Q4 vs 8 GB here
  • Little room for context: Qwen3.5 9B uses 6.6 of 8 GB, 1.4 GB left
  • Slow prompt reading: A 4K-token prompt on Qwen3.5 9B waits 21.4 s for the first token
  • No FP8 or NVFP4: Pascal predates both; use GGUF, AWQ or GPTQ builds

Speed per dollar and per watt

On Qwen3.5 9B (9B params) at Q4_K_M. New prices are compared with new, used with used. The last two columns are the speed you get per $100 of price and per 100 W of board power; higher is better. The GTX 1070 Ti has no new price, so the New view shows it at its MSRP.

CardNew pricetok/stok/s per $100tok/s per 100 W
RTX 50608 GBBest new value
about $46045.8
10.0
31.6
RTX 507012 GB
about $84068.7
8.2
27.5
GTX 1070 Ti8 GB
about $44926.2
5.8
14.6
RTX 40608 GB
about $52027.8
5.3
24.2
CardUsed pricetok/stok/s per $100tok/s per 100 W
GTX 1070 Ti8 GB
about $10526.2
25.0
14.6
RTX 3060 12GB12 GB
about $32936.8
11.2
21.6
RTX 50608 GBBest used value
about $43045.8
10.7
31.6
RTX 407012 GB
about $57551.5
9.0
25.8
RTX 40608 GB
about $33527.8
8.3
24.2
RTX 4070 SUPER12 GB
about $67551.5
7.6
23.4
RTX 4060 Ti 8GB8 GB
about $40029.4
7.4
18.4
RTX 4070 Ti12 GB
about $72251.5
7.1
18.1

Cost per token: the GTX 1070 Ti against 8–12 GB cards

On Qwen3.5 9B (9B params, Q4_K_M, 4K context). Speed, cost per token and power per token depend on the model.

8 GB12 GBthis cardat MSRP
$0.00$0.50$1.00$1.50$0$1,000$ per 1M output tokens · lower is betterused price →RTX 3060 12GB · 12 GB · ≈$329 · $0.76 per 1M tokensRTX 5060 · 8 GB · ≈$430 · $0.73 per 1M tokensRTX 5070 · 12 GB · ≈$736 · $0.83 per 1M tokensRTX 4070 SUPER · 12 GB · ≈$675 · $1.01 per 1M tokensRTX 4070 Ti · 12 GB · ≈$722 · $1.12 per 1M tokensRTX 4060 · 8 GB · ≈$335 · $0.94 per 1M tokensRTX 4070 · 12 GB · ≈$575 · $0.87 per 1M tokensRTX 4060 Ti 8GB · 8 GB · ≈$400 · $1.09 per 1M tokensGTX 1070 Ti · 8 GB · ≈$105 · $0.54 per 1M tokensGTX 1070 TiRTX 5060RTX 5070RTX 4070 SUPERRTX 4070 TiRTX 4070RTX 3060 12GB
$0.00$0.50$1.00$1.50$0$1k$ per 1M output tokens · lower is betterused price →RTX 3060 12GB · 12 GB · ≈$329 · $0.76 per 1M tokensRTX 5060 · 8 GB · ≈$430 · $0.73 per 1M tokensRTX 5070 · 12 GB · ≈$736 · $0.83 per 1M tokensRTX 4070 SUPER · 12 GB · ≈$675 · $1.01 per 1M tokensRTX 4070 Ti · 12 GB · ≈$722 · $1.12 per 1M tokensRTX 4060 · 8 GB · ≈$335 · $0.94 per 1M tokensRTX 4070 · 12 GB · ≈$575 · $0.87 per 1M tokensRTX 4060 Ti 8GB · 8 GB · ≈$400 · $1.09 per 1M tokensGTX 1070 Ti · 8 GB · ≈$105 · $0.54 per 1M tokensGTX 1070 TiRTX 5060RTX 5070
Cost per 1M output tokenson Qwen3.5 9B · card over 3 years + power
$0.54
Card, used price
$0.25
Power
$0.29
3-year cost of ownership$223
Or rent an RTX 3090 in the cloud$0.18/hr

Renting costs as much as buying after ≈600 hours (≈0.4 years at 4 h a day).

Include card price

Each dot is a card; hover or tap it for its numbers, click to open it. Cards without a price for the chosen basis are left out. How we calculate cost per token

Similar GPUs

Cards people weigh against the GTX 1070 Ti, each with the one reason it is worth a look. Speeds on Qwen3.5 9B.

4 GB more and 41% fasterRTX 3060 12GBNVIDIA · 12 GB · Ampere
▲ 41% speed▲ 4 GBabout $329rent $0.06/hr
75% faster, same 8 GBRTX 5060NVIDIA · 8 GB · Blackwell
▲ 75% speedsame 8 GBabout $460
4 GB more and 56% fasterRX 9070 GREAMD · 12 GB · RDNA 4
▲ 56% speed▲ 4 GBabout $549
54% faster, same 8 GBA580Intel · 8 GB · Alchemist
▲ 54% speedsame 8 GBabout $179
8 GB more and 2.8× the speedRTX 4080NVIDIA · 16 GB · Ada Lovelace
▲ 180% speed▲ 8 GBabout $1,199rent $0.25/hr
8 GB more and 2.9× the speedRTX 4080 SUPERNVIDIA · 16 GB · Ada Lovelace
▲ 187% speed▲ 8 GBabout $999rent $0.32/hr

GTX 1070 Ti tokens per second by model size

Output speed depends on memory bandwidth (256 GB/s). Grey rows need more than 8 GB.

  1. 9BQwen3.5 9B · Q4_K_M · 6.6 GB
    26.2tok/s
  2. 14BQwen3 14B · not at 4-bit
    needs 11.9 GB
  3. 27–31BQwen3.8 27B · not at 4-bit
    needs 17.9 GB
  4. 35B MoEQwen3.6 35B A3B · not at 4-bit
    needs 22.0 GB
  5. 70BLlama 3.3 70B Instruct · not at 4-bit
    needs 51.3 GB
  6. 120B MoEGPT OSS 120B · not at 4-bit
    needs 70.8 GB

Estimated speeds: Q4_K_M, 4K context, one user. How we estimate

All 842 models on the GTX 1070 Ti

Featured only

Best quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works

LLM models compatible with NVIDIA GeForce GTX 1070 Ti — ranked by Score, recency and Fit
ModelVRAMScoreFit
Moondream2
Q4_K_M·131.0 t/s
3.0 GBS95, Runs great
Tiny GptOssForCausalLM
Q4_K_M·554.7 t/s
0.6 GBS100, Runs great
Tiny Random ArceeForCausalLM
Q4_K_M·554.7 t/s
0.3 GBS100, Runs great
Archaea 74M
Q4_K_M·475.4 t/s
0.3 GBS100, Runs great
Tiny GptOssForCausalLM
Q4_K_M·536.8 t/s
0.3 GBS100, Runs great
Kimi Linear Tiny Random
BF16·529.9 t/s
0.3 GBS100, Runs great
SmolLM 135M Instruct FP32
Q4_K_M·387.0 t/s
0.4 GBS100, Runs great
SmolVLM2 256M Video Instruct
Q4_K_M·332.8 t/s
0.6 GBS100, Runs great
Functiongemma 270M Ft Mobile Actions
BF16·282.0 t/s
1.6 GBS100, Runs great
MobileLLM R1 360M
Q4_K_M·693.3 t/s
1.3 GBS100, Runs great
SmolVLM2 2.2B Instruct
Q4_K_M·112.4 t/s
2.3 GBS94, Runs great
Supra Mini V5 8M
Q4_K_M·520.0 t/s
0.3 GBS100, Runs great
GPT X2 125M
BF16·260.0 t/s
0.6 GBS100, Runs great
Surya Ocr 2.5
Q4_K_M·218.9 t/s
0.8 GBS100, Runs great
Quark 135M
Q4_K_M·387.0 t/s
0.4 GBS100, Runs great

GTX 1070 Ti specs, power and PSU

Specs

Architecture
Pascal
VRAM
8 GB GDDR5
Memory bandwidth
256.0 GB/s
FP16 (dense)
8.19 TFLOPS
CUDA cores
2,432
Tensor cores
0
Compute capability
6.1
TDP
180 W
Released
2017-11-02
MSRP
$449

GTX 1070 Ti FAQ

Is the GTX 1070 Ti still worth it in 2026?

At ≈$105 used you get 25.0 tok/s per $100 on Qwen3.5 9B, which ranks 1st of the 8 cards compared here; it is also the 16th fastest out of 20 cards with 8 GB. It runs 7–9B models well; 14B doesn't fit in 8 GB.

What is the largest model the GTX 1070 Ti can run?

Qwen3.5 9B (9.7B) is the largest at 4-bit or better: at Q4_K_M it uses 6.6 GB of 8 GB, and runs at about 26.2 tok/s.

Can the GTX 1070 Ti run 14B models?

No. Qwen3 14B needs 11.9 GB at Q4, more than the 8 GB on this card.

How many tokens per second does the GTX 1070 Ti give?

About 26.2 tok/s on Qwen3.5 9B at Q4_K_M, with the first token after 21.5 s on a 4K-token prompt.

What power supply does the GTX 1070 Ti need?

Plan a 400 W PSU (2× the 180 W TDP).

Is renting cheaper than buying a GTX 1070 Ti?

An RTX 3090 (24 GB) rents from $0.18/hr. Renting costs as much as buying after ≈600 hours (≈0.4 years at 4 h a day).

Related

Best coding LLMs8 GB VRAM12 GB VRAMGPUs with 8 GB or moreRTX 5080RTX 3080 Ti