Family Gemma · 4B parameters

Gemma 4 E4B

4B effective multimodal (text+image+audio). 140 languages. For laptops and edge devices.

🇺🇸 Google·License Apache 2.0·Context 125k tokens·Output April 2026·Fits within the 128 GB of the GIGABYTE AI TOP ATOM← Catalog

01What it can do

Strengths
  • Full multimodal support in 4B
  • 128k context
  • Runs on laptops and mobile devices
  • Apache 2.0
Limitations to know
  • —Below 12B+ quality
Architecture
E4B “efficient” · 4.5B active / 8B total · text+image+audio multimodal
Training
Edge/mobile edition of Gemma 4.
Ideal for
Edge multimodalOn-deviceTiny audio

05Install

Install Ollama for your OS. Check the model and its quantization before downloading. Start with 4096 tokens of context, then check placement with ollama ps. A command below is not proof that a test was run on your machine.

$ollama run gemma4:e4b
⚠
First download: between 2 and 40 GB depending on the selected quantization. Plan for sufficient disk space; a stable connection is recommended. Subsequent launches are instant.

02Required memory

Approximate GPU VRAM required to run this model, including 4k tokens of context overhead. For a longer context, add ~1 GB per 8k-token increment.

Q4_K_M
The lightest, ~5% loss
10 GB
Q5_K_M
Good quality/size compromise
11 GB
Q8_0
Nearly indistinguishable from FP16
12 GB
FP16
Full precision — server use
16 GB
Fallback CPU · If you don't have a GPU, allow 12 GB of RAM minimum to run this model at reduced speed.

What hardware do you need for Gemma 4 E4B?

To run Gemma 4 E4B locally with Q4 quantization, you need about 10 GB of VRAM. An option to compare: RTX 5070 12GB (ASUS Prime OC) — leave some headroom for the system and context; check engine compatibility with the GPU.

Current offer: RTX 5070 12GB (ASUS Prime OC)
AmazonSee price →

Affiliate links — commission possible at no extra cost to you; independent recommendations. As an Amazon Associate, BestLLMfor earns from qualifying purchases.

On the go: Gemma 4 E4B also runs on a RTX laptop PC (16 GB of VRAM) →

This model in your private ChatGPT, without the cloud

Your private ChatGPT, free, on your own machine in an hour — LM Studio, Ollama, Open WebUI, your documents, no cloud.

  • Lifetime online access
  • PDF + files
  • Lifetime updates

03Expected speed

Tokens generated per second in Q4_K_M, 4k context. Beyond 20 t/s, reading is comfortable. Below 10 t/s, that's just for testing.

Entry-level
~14t/s
GTX 1650, RX 6600, MBA M2 8GB
Mid-range
~40t/s
RTX 4060, 4070, MBP M3 Pro
High-end
~100t/s
RTX 4090, M4 Max, Radeon 7900

04Public benchmarks

Scores reproduced from model cards or MMLU-Pro / community sources. Unit: % correct answers.

MMLU Pro
69.4
LiveCodeBench v6
52
GPQA Diamond
58.6
MMMU Pro (vision)
52.6