NVIDIA · Pascal · 8 GB VRAM tier
Best AI Models for NVIDIA GeForce GTX 1070 Ti (8 GB)
Runs 7–9B models well; 14B doesn't fit in 8 GB.
8 GB at 256 GB/s: fits ~7-8B at Q4. Pascal: no Tensor Cores and very slow FP16, so it runs GGUF (llama.cpp, Ollama) fine but not FP16 runtimes like vLLM; current CUDA 13 builds dropped Pascal — use CUDA 12 or Vulkan builds.
| # | Model | Speed | llmrun Score | Quant · VRAM |
|---|---|---|---|---|
| 1 | Qwen3.5 9BAlibabaHow to run → Q4_K_M · 6.6 GB · 26.2 t/s | 26.2 tok/s | Q4_K_M · 6.6 GB | |
| 2 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 51.0 t/s | 51.0 tok/s | Q4_K_M · 3.4 GB | |
| 3 | Gemma 2 9B ITGoogle Q4_K_M · 7.3 GB · 27.3 t/s | 27.3 tok/s | Q4_K_M · 7.3 GB | |
| 4 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 58.6 t/s | 58.6 tok/s | Q4_K_M · 5.0 GB | |
| 5 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 144 t/s | 144 tok/s | Q4_K_M · 5.5 GB |
| # | Model | Speed | Reasoning Score | Quant · VRAM |
|---|---|---|---|---|
| 1 | Qwen3.5 9BAlibabaHow to run → Q4_K_M · 6.6 GB · 26.2 t/s | 26.2 tok/s | Q4_K_M · 6.6 GB | |
| 2 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 58.6 t/s | 58.6 tok/s | Q4_K_M · 5.0 GB | |
| 3 | Qwen2.5 7B InstructAlibaba Q4_K_M · 5.8 GB · 33.3 t/s | 33.3 tok/s | Q4_K_M · 5.8 GB | |
| 4 | Gemma 2 9B ITGoogle Q4_K_M · 7.3 GB · 27.3 t/s | 27.3 tok/s | overall | Q4_K_M · 7.3 GB |
| 5 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 144 t/s | 144 tok/s | Q4_K_M · 5.5 GB |
| # | Model | Speed | Long context Score | Quant · VRAM |
|---|---|---|---|---|
| 1 | Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 51.0 t/s | 51.0 tok/s | Q4_K_M · 3.4 GB | |
| 2 | Qwen3.5 9BAlibaba Q4_K_M · 6.6 GB · 26.2 t/s | 26.2 tok/s | Q4_K_M · 6.6 GB | |
| 3 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 144 t/s | 144 tok/s | Q4_K_M · 5.5 GB | |
| 4 | Gemma 4 E4B ITGoogle Q4_K_M · 5.6 GB · 31.3 t/s | 31.3 tok/s | Q4_K_M · 5.6 GB | |
| 5 | Spark X2.6 4BXHToken Q4_K_M · 4.3 GB · 56.2 t/s | 56.2 tok/s | Q4_K_M · 4.3 GB |
| # | Model | Speed ↓ | llmrun Score | Quant · VRAM |
|---|---|---|---|---|
| 1 | Qwen3.5 4BAlibabaHow to run → Q4_K_M · 3.4 GB · 51.0 t/s | 51.0 tok/s | Q4_K_M · 3.4 GB | |
| 2 | Ling 3.0 TinyInclusion AI Q4_K_M · 5.5 GB · 144 t/s | 144 tok/s | Q4_K_M · 5.5 GB | |
| 3 | Gemma 4 E4B ITGoogle Q4_K_M · 5.6 GB · 31.3 t/s | 31.3 tok/s | Q4_K_M · 5.6 GB | |
| 4 | Q4_K_M · 6.5 GB · 26.8 t/s | 26.8 tok/s | Q4_K_M · 6.5 GB | |
| 5 | Qwen3.5 9BAlibaba Q4_K_M · 6.6 GB · 26.2 t/s | 26.2 tok/s | Q4_K_M · 6.6 GB |
| # | Model | Speed | Vision Score | Quant · VRAM |
|---|---|---|---|---|
| 1 | Qwen3.5 9BAlibabaHow to run → Q4_K_M · 6.6 GB · 26.2 t/s | 26.2 tok/s | Q4_K_M · 6.6 GB | |
| 2 | Qwen3.5 4BAlibaba Q4_K_M · 3.4 GB · 51.0 t/s | 51.0 tok/s | Q4_K_M · 3.4 GB | |
| 3 | Gemma 3 4B ITGoogle Q4_K_M · 5.0 GB · 58.6 t/s | 58.6 tok/s | Q4_K_M · 5.0 GB | |
| 4 | Q4_K_M · 6.5 GB · 26.8 t/s | 26.8 tok/s | Q4_K_M · 6.5 GB | |
| 5 | MiniCPM V 4.7 1BOpenBMB Q4_K_M · 1.6 GB · 130 t/s | 130 tok/s | Q4_K_M · 1.6 GB |
The GTX 1070 Ti is an entry card in the 8 GB class: it runs 7–9B models well. It is power-hungry for its speed, and the best speed per dollar of the cards compared at ≈$105 used. Pascal generation, released 2017.
GTX 1070 Ti strengths and weaknesses
Strengths
- Runs 7–9B models: Qwen3.5 9B at 26.2 tok/s in 6.6 GB
Weaknesses
- 14B models don't fit: Qwen3 14B needs 11.9 GB at Q4 vs 8 GB here
- Little room for context: Qwen3.5 9B uses 6.6 of 8 GB, 1.4 GB left
- Slow prompt reading: A 4K-token prompt on Qwen3.5 9B waits 21.4 s for the first token
- No FP8 or NVFP4: Pascal predates both; use GGUF, AWQ or GPTQ builds
Speed per dollar and per watt
On Qwen3.5 9B (9B params) at Q4_K_M. New prices are compared with new, used with used. The last two columns are the speed you get per $100 of price and per 100 W of board power; higher is better. The GTX 1070 Ti has no new price, so the New view shows it at its MSRP.
| Card | New price | tok/s | tok/s per $100 | tok/s per 100 W |
|---|---|---|---|---|
RTX 50608 GBBest new value | about $460 | 45.8 | 10.0 | 31.6 |
RTX 507012 GB | about $840 | 68.7 | 8.2 | 27.5 |
GTX 1070 Ti8 GB | about $449 | 26.2 | 5.8 | 14.6 |
RTX 40608 GB | about $520 | 27.8 | 5.3 | 24.2 |
| Card | Used price | tok/s | tok/s per $100 | tok/s per 100 W |
|---|---|---|---|---|
GTX 1070 Ti8 GB | about $105 | 26.2 | 25.0 | 14.6 |
RTX 3060 12GB12 GB | about $329 | 36.8 | 11.2 | 21.6 |
RTX 50608 GBBest used value | about $430 | 45.8 | 10.7 | 31.6 |
RTX 407012 GB | about $575 | 51.5 | 9.0 | 25.8 |
RTX 40608 GB | about $335 | 27.8 | 8.3 | 24.2 |
RTX 4070 SUPER12 GB | about $675 | 51.5 | 7.6 | 23.4 |
RTX 4060 Ti 8GB8 GB | about $400 | 29.4 | 7.4 | 18.4 |
RTX 4070 Ti12 GB | about $722 | 51.5 | 7.1 | 18.1 |
Cost per token: the GTX 1070 Ti against 8–12 GB cards
On Qwen3.5 9B (9B params, Q4_K_M, 4K context). Speed, cost per token and power per token depend on the model.
- Card, used price
- $0.25
- Power
- $0.29
Renting costs as much as buying after ≈500 hours (≈0.3 years at 4 h a day).
Each dot is a card; hover or tap it for its numbers, click to open it. Cards without a price for the chosen basis are left out. How we calculate cost per token
Cards people weigh against the GTX 1070 Ti, each with the one reason it is worth a look. Speeds on Qwen3.5 9B.
Output speed depends on memory bandwidth (256 GB/s). Grey rows need more than 8 GB.
- 9BQwen3.5 9B · Q4_K_M · 6.6 GB26.2tok/s
- 14BQwen3 14B · not at 4-bitneeds 11.9 GB
- 27–31BQwen3.8 27B · not at 4-bitneeds 17.9 GB
- 35B MoEQwen3.6 35B A3B · not at 4-bitneeds 22.0 GB
- 70BLlama 3.3 70B Instruct · not at 4-bitneeds 51.3 GB
- 120B MoEGPT OSS 120B · not at 4-bitneeds 70.8 GB
Estimated speeds: Q4_K_M, 4K context, one user. How we estimate
All 842 models on the GTX 1070 Ti
Featured onlyBest quant that fits, ordered by llmrun Score. Fit grades how well it runs here, S best. How ranking works
| Model | Quant | VRAM | Speed | Context | Score | Fit |
|---|---|---|---|---|---|---|
| Q4_K_M | 6.8 GB | 33.9 t/s | 33K | A66, Runs well | ||
Qwen2.5 Coder 0.5BChatCodeFunctions | Q4_K_M | 0.8 GB | 268.4 t/s | 33K | S100, Runs great | |
Qwen1.5 1.8BChat | Q4_K_M | 4.6 GB | 92.4 t/s | 33K | S90, Runs great | |
Meta Llama 3 8BChat | Q4_K_M | 7.9 GB | 31.4 t/s | — | C43, Usable | |
Qwen2.5 Coder 7BChatCodeFunctions | Q4_K_M | 5.8 GB | 33.3 t/s | 33K | A72, Runs well | |
DeepSeek R1 Distill Qwen 14BChatReasoningFunctions | IQ2_XS | 8.0 GB | 32.4 t/s | 131K | C42, Usable | |
| Q4_K_M | 7.7 GB | 25.8 t/s | 8K | C42, Usable | ||
Qwen2.5 Coder 14B InstructChatCodeFunctions | IQ2_XS | 8.0 GB | 32.4 t/s | 33K | C42, Usable | |
Hermes 4 14BChatReasoningRoleplayFunctions | IQ2_M | 8.0 GB | 29.6 t/s | 41K | C39, Usable | |
Llama 3.2 11B Vision InstructVisionFunctions | Q2_K | 7.8 GB | 33.3 t/s | — | B46, Decent | |
Granite 3.1 8B InstructChatFunctions | Q4_K_M | 7.9 GB | 30.0 t/s | 131K | C41, Usable | |
| Q4_K_M | 8.0 GB | 30.8 t/s | — | C40, Usable | ||
Phi 4 Reasoning PlusChatMathCodeReasoning | IQ2_XXS | 7.7 GB | 35.0 t/s | 33K | B48, Decent | |
Lucid V1 NemoChat | IQ2_M | 7.8 GB | 34.3 t/s | 131K | B46, Decent | |
| BF16 | 7.6 GB | 28.9 t/s | — | B47, Decent |
Specs
- Architecture
- Pascal
- VRAM
- 8 GB GDDR5
- Memory bandwidth
- 256.0 GB/s
- FP16 (dense)
- 8.19 TFLOPS
- CUDA cores
- 2,432
- Tensor cores
- 0
- Compute capability
- 6.1
- TDP
- 180 W
- Released
- 2017-11-02
- MSRP
- $449
GTX 1070 Ti FAQ
Is the GTX 1070 Ti still worth it in 2026?
At ≈$105 used you get 25.0 tok/s per $100 on Qwen3.5 9B, which ranks 1st of the 8 cards compared here; it is also the 16th fastest out of 20 cards with 8 GB. It runs 7–9B models well; 14B doesn't fit in 8 GB.
What is the largest model the GTX 1070 Ti can run?
Qwen3.5 9B (9.7B) is the largest at 4-bit or better: at Q4_K_M it uses 6.6 GB of 8 GB, and runs at about 26.2 tok/s.
Can the GTX 1070 Ti run 14B models?
No. Qwen3 14B needs 11.9 GB at Q4, more than the 8 GB on this card.
How many tokens per second does the GTX 1070 Ti give?
About 26.2 tok/s on Qwen3.5 9B at Q4_K_M, with the first token after 21.5 s on a 4K-token prompt.
What power supply does the GTX 1070 Ti need?
Plan a 400 W PSU (2× the 180 W TDP).
Is renting cheaper than buying a GTX 1070 Ti?
An RTX 5080 (16 GB) rents from $0.22/hr. Renting costs as much as buying after ≈500 hours (≈0.3 years at 4 h a day).