Family Hunyuan · 406B parameters

Hunyuan Large 2.0

Flagship: 406B/32B active parameters. 256k ctx. ⚠ Custom Tencent license.

🇨🇳 Tencent·License Tencent Hunyuan License·Context 256k tokens·Output November 2024← Catalog

01What it can do

Strengths
  • 262k context
  • Strong in Chinese
  • 52B active parameters effective on 406B
Limitations to know
  • —245 GB VRAM Q4 — heavy infrastructure required
  • —Tencent license to verify
Architecture
MoE · 406B total / 52B active · Tencent HunyuanLLM · 262k ctx
Training
Tencent — strong in Chinese and English, RAG, and long documents.
Ideal for
CN boundaryLong context

04Install

Install Ollama for your OS. Check the model and its quantization before downloading. Start with 4096 tokens of context, then check placement with ollama ps. A command below is not proof that a test was run on your machine.

$# Infrastructure Tencent — non disponible en local standard
⚠
First download: between 2 and 40 GB depending on the selected quantization. Plan for sufficient disk space; a stable connection is recommended. Subsequent launches are instant.

02Required memory

Approximate GPU VRAM required to run this model, including 4k tokens of context overhead. For a longer context, add ~1 GB per 8k-token increment.

Q4_K_M
The lightest, ~5% loss
245 GB
Q5_K_M
Good quality/size compromise
290 GB
Q8_0
Nearly indistinguishable from FP16
435 GB
FP16
Full precision — server use
810 GB
Fallback CPU · If you don't have a GPU, allow 300 GB of RAM minimum to run this model at reduced speed.

What hardware do you need for Hunyuan Large 2.0?

To run Hunyuan Large 2.0 locally with Q4 quantization, you need about 245 GB of VRAM. An option to compare: BOSGAME M5 128GB / 2TB (Ryzen AI Max+ 395) — this model exceeds this mini-PC's GPU capacity: choose a smaller model or suitable infrastructure.

Current offer: BOSGAME M5 128GB / 2TB (Ryzen AI Max+ 395)
AmazonSee price →

Why this choice? Our complete guide on BOSGAME M5 128GB / 2TB (Ryzen AI Max+ 395) →

Affiliate links — possible commission at no extra cost to you; independent recommendations. As an Amazon Associate, BestLLMfor earns from qualifying purchases.

This model in your private ChatGPT, without the cloud

Too large for your machine? The kit gives you the model that fits in your VRAM

  • Lifetime online access
  • PDF + files
  • Lifetime updates

03Expected speed

Tokens generated per second in Q4_K_M, 4k context. Beyond 20 t/s, reading is comfortable. Below 10 t/s, that's just for testing.

Entry-level
~1t/s
GTX 1650, RX 6600, MBA M2 8GB
Mid-range
~4t/s
RTX 4060, 4070, MBP M3 Pro
High-end
~12t/s
RTX 4090, M4 Max, Radeon 7900