Home › Catalog › Best LLM for RTX 2080 (8 GB) in 2026

Best LLM for RTX 2080 (8 GB) in 2026

◆ Local AI — Your private ChatGPT, free, on your own machine, in an hour · $24 · or all kits $49 →

Ranking updated on 09/10/2026

The RTX 2080 (8 GB GDDR6, 448 GB/s) remains functional for 7–9B models in Q4. Decent bandwidth, but 8 GB is limiting. A solid used entry-level option at around €150–200.

Offers and alternatives for local AI

RTX 2080 : purchasing alternative available for local AI — RTX 5060 Ti 16 GB :

Which PC should you choose for your budget? Our picks from €800 to €3,500 →

Affiliate links — BestLLMfor may earn a commission on purchases, at no extra cost to you, which does not influence the ranking (established independently). As an Amazon Associate, BestLLMfor earns from qualifying purchases.

Ranking

1

🇺🇸 OLMo 3 7B Think (SFT)

zimplex · 7B parameters · Apache 2.0 · 16,000 tokens ctx

SFT “thinking” fine-tune of OLMo 3 7B: step-by-step reasoning, 16k context, ~4.2 GB VRAM in Q4. 100% open, Apache 2.0 license.

Why this ranking SFT “thinking” fine-tune of OLMo 3 7B: step-by-step reasoning, 16k context, ~4.2 GB VRAM in Q4. 100% open, Apache 2.0 license.
# HuggingFace : zimplex/olmo3-7b-think-sft-eosfix-16k-3ep-euc
On RTX 2080
Q8
8 GB · 32 tok/s
2

🇨🇳 GLM 5.3 7B

Zhipu AI · 7B parameters · MIT · 128,000 tokens ctx

GLM 5.3 (Zhipu): dense 7B specialized in code and reasoning, 128k context, ~4.1 GB VRAM in Q4. Lightweight, runs on a 6–8 GB GPU, MIT license.

Why this ranking GLM 5.3 (Zhipu): dense 7B specialized in code and reasoning, 128k context, ~4.1 GB VRAM in Q4. Lightweight, runs on a 6–8 GB GPU, MIT license.
ollama pull glm-5.3
On RTX 2080
Q8
7 GB · 32 tok/s
3

🇺🇸 Granite 4.1 8B Instruct

IBM · 8B parameters · Apache 2.0 · 131,072 tokens ctx

Dense 8B Apache 2.0, 12 languages including FR, 131k context, GQA 32Q/8KV. MMLU 73.84, HumanEval 85.37. Released April 29, 2026.

Why this ranking Dense 8B Apache 2.0, 12 languages including FR, 131k context, GQA 32Q/8KV. MMLU 73.84, HumanEval 85.37. Released April 29, 2026.
# HuggingFace : ibm-granite/granite-4.1-8b
On RTX 2080
Q5_K_M
6 GB · 12 tok/s
4

🇺🇸 OLMo 3 7B

Allen AI · 7B parameters · Apache 2.0 · 8,192-token context

Dense 7B 100% open (weights + data + code). Complete transparency for research.

Why this ranking Dense 7B 100% open (weights + data + code). Complete transparency for research.
ollama run olmo-3:7b
On RTX 2080
Q5_K_M
6 GB · 12 tok/s
5

🇺🇸 Granite 4.2 8B

IBM · 8B parameters · Apache 2.0 · 128,000 tokens ctx

Granite 4.2 8B (IBM): dense Apache 2.0, 128k context, ~4.6 GB Q4 VRAM. Multilingual chat, coding, and reasoning for the enterprise.

Why this ranking Granite 4.2 8B (IBM): dense Apache 2.0, 128k context, ~4.6 GB Q4 VRAM. Multilingual chat, coding, and reasoning for the enterprise.
ollama pull granite4.2
On RTX 2080
Q5_K_M
6 GB · 32 tok/s
6

🇺🇸 LFM2.5 7B

Liquid AI · 7B parameters · LFM Open License v1.0 · 32,768-token context

LFM2.5 7B (Liquid AI): dense Liquid Foundation Model, 32k context, 4.1 GB VRAM Q4. Optimized for CPU and edge. Released May 2026.

Why this ranking LFM2.5 7B (Liquid AI): dense Liquid Foundation Model, 32k context, 4.1 GB VRAM Q4. Optimized for CPU and edge. Released May 2026.
ollama pull lfm2.5
On RTX 2080
Q8
7 GB · 32 tok/s
7

🇺🇸 LFM2.5 DSpark

Liquid AI · 7B parameters · LFM Open License v1.0 · 32,768-token context

LFM2.5 DSpark (Liquid AI): dense 7B Liquid Foundation Model, 32k context, ~4.1 GB VRAM Q4. Versatile chat optimized for edge/CPU.

Why this ranking LFM2.5 DSpark (Liquid AI): dense 7B Liquid Foundation Model, 32k context, ~4.1 GB VRAM Q4. Versatile chat optimized for edge/CPU.
# HuggingFace : LiquidAI/LFM2.5-DSpark
On RTX 2080
Q8
7 GB · 32 tok/s

Comparison table

Rank Model Params Q4 VRAM Context License On RTX 2080
#1 OLMo 3 7B Think (SFT) 7B 4.2 GB 16 000 Apache 2.0 32 tok/s · Q8
#2 GLM 5.3 7B 7B 4.1 GB 128 000 MIT 32 tok/s · Q8
#3 Granite 4.1 8B Instruct 8B 5 GB 131 072 Apache 2.0 12 tok/s · Q5_K_M
#4 OLMo 3 7B 7B 5 GB 8 192 Apache 2.0 12 tok/s · Q5_K_M
#5 Granite 4.2 8B 8B 4.6 GB 128 000 Apache 2.0 32 tok/s · Q5_K_M
#6 LFM2.5 7B 7B 4.1 GB 32 768 LFM Open License v1.0 32 tok/s · Q8
#7 LFM2.5 DSpark 7B 4.1 GB 32 768 LFM Open License v1.0 32 tok/s · Q8
The Local AI Kit

Your private, free ChatGPT on your machine in 1 hour — LM Studio, Ollama, Open WebUI, your documents, no cloud.

  • Lifetime online access
  • PDF + files
  • Lifetime updates

Free memo

Which coding model should you run on YOUR machine?

Get the memo VRAM → best coding model → Ollama command (one screen, copy and paste). Then switch to the Copilote Local kit for a setup that actually works.

The Local Copilot kit — the Ollama + Cline + Aider configs are ready to paste, with tuned Modelfiles, troubleshooting, and lifetime online access →

No spam. Unsubscribe in 1 click. Your data stays with us (never resold).

Ranking methodology

Filter: Q4_K_M ≤ 7 GB. 3–9B bonus. 448 GB/s = correct entry.

Criteria considered:

  • Q4_K_M ≤ 7 GB
  • Mistral 7B Q4 at 28 tok/s
  • GDDR6 448 GB/s
  • Used ~€150–200

The scoring is fully transparent: see our methodology for details on VRAM/tokens/sec calculations.

Frequently asked questions

RTX 2080 8 GB in 2026?

Still usable for 7–9B in Q4. Mistral 7B Q4 (~4.5 GB) at 28 tok/s, Phi-4 Mini at 45+ tok/s. For 13B+, target 12 GB. See guide.

2080 vs 3060 12 GB?

Similar bandwidth (448 vs. 360 GB/s). 3060 12 GB = +4 GB VRAM = 13–14B accessible. 3060 12 GB wins for LLMs. See 3060 12GB.

Should you buy a used 2080 in 2026?

Only if it is < €150. Otherwise, prefer the 3060 12 GB (~€200), which supports 13–14B Q4. See RTX 3060 12GB.

Which models are the sweet spot for the 2080?

Mistral 7B Q5 (~5.5 GB, 30 tok/s), Qwen 3 8B Q4 (~5 GB, 27 tok/s), Llama 3.2 3B Q4 (~2 GB, 60+ tok/s).

Go further

BestLLMfor Kits The reference guide by use case
All kits for life — $49

Prices in euros (€) are French market prices including VAT, as checked by BestLLMfor. US prices differ: the Amazon buttons show the current US price.