Family Jais · 30B parameters

Jais 30B Chat v3

The leading open Arabic LLM. Native architecture (not a fine-tune). Bilingual AR/EN.

MBZUAI / Core42·License Apache 2.0·Context 8k tokens·Output August 2023 (v3 2024)·Fits within the 128 GB of the GIGABYTE AI TOP ATOM← Catalog

01What it can do

Strengths
  • Native Arabic architecture
  • AR/EN bilingual
  • Apache 2.0
Limitations to know
  • —8k context only
  • —No official Ollama
Architecture
Native decoder · SwiGLU · ALiBi · Arabic-first
Training
MBZUAI + Core42 + Cerebras.
Ideal for
ArabicMENA sovereignty

04Install

Install Ollama for your OS. Check the model and its quantization before downloading. Start with 4096 tokens of context, then check placement with ollama ps. A command below is not proof that a test was run on your machine.

$# HuggingFace : core42/jais-30b-chat-v3
⚠
First download: between 2 and 40 GB depending on the selected quantization. Plan for sufficient disk space; a stable connection is recommended. Subsequent launches are instant.

02Required memory

Approximate GPU VRAM required to run this model, including 4k tokens of context overhead. For a longer context, add ~1 GB per 8k-token increment.

Q4_K_M
The lightest, ~5% loss
18 GB
Q5_K_M
Good quality/size compromise
22 GB
Q8_0
Nearly indistinguishable from FP16
33 GB
FP16
Full precision — server use
60 GB
Fallback CPU · If you don't have a GPU, allow 28 GB of RAM minimum to run this model at reduced speed.

What hardware do you need for Jais 30B Chat v3?

To run Jais 30B Chat v3 locally with Q4 quantization, you need about 18 GB of VRAM. An option to compare: GMKtec EVO-X2 64GB / 1TB (Ryzen AI Max+ 395) — leave some headroom for the system and context; check engine compatibility with the GPU.

Current offer: GMKtec EVO-X2 64GB / 1TB (Ryzen AI Max+ 395)
AmazonSee price →

Why this choice? Our complete guide on GMKtec EVO-X2 64GB / 1TB (Ryzen AI Max+ 395) →

Affiliate links — commission possible at no extra cost to you; independent recommendations. As an Amazon Associate, BestLLMfor earns from qualifying purchases.

On the go: Jais 30B Chat v3 also runs on a RTX laptop PC (24 GB of VRAM) →

This model in your private ChatGPT, without the cloud

Your private ChatGPT, free, on your own machine in an hour — LM Studio, Ollama, Open WebUI, your documents, no cloud.

  • Lifetime online access
  • PDF + files
  • Lifetime updates

03Expected speed

Tokens generated per second in Q4_K_M, 4k context. Beyond 20 t/s, reading is comfortable. Below 10 t/s, that's just for testing.

Entry-level
~3t/s
GTX 1650, RX 6600, MBA M2 8GB
Mid-range
~13t/s
RTX 4060, 4070, MBP M3 Pro
High-end
~32t/s
RTX 4090, M4 Max, Radeon 7900