Family North · 30.5B parameters

North Mini Code 1.0

Cohere 30.5B model focused on agentic coding and reasoning. 488k context, Apache 2.0, ~18 GB VRAM in Q4.

🇺🇸 Cohere·License Apache 2.0·Context 476.5625k tokens·Output Jun 5, 2026·Fits within the 128 GB of the GIGABYTE AI TOP ATOM← Catalog

01What it can do

Strengths
  • Very long context (488k)
  • Apache 2.0 commercial
  • Agentic coding and reasoning
  • ~18 GB VRAM in Q4
Limitations to know
  • —Code-focused, less versatile in general chat
  • —Moderate inference throughput
Architecture
Dense 30.5B · 488k context
Training
Cohere, North line focused on agentic coding and reasoning. Apache 2.0 license.
Ideal for
Agentic codingReasoningLong context

04Install

Install Ollama for your OS. Check the model and its quantization before downloading. Start with 4096 tokens of context, then check placement with ollama ps. A command below is not proof that a test was run on your machine.

$ollama run north-mini-code-1.0
⚠
First download: between 2 and 40 GB depending on the selected quantization. Plan for sufficient disk space; a stable connection is recommended. Subsequent launches are instant.

02Required memory

Approximate GPU VRAM required to run this model, including 4k tokens of context overhead. For a longer context, add ~1 GB per 8k-token increment.

Q4_K_M
The lightest, ~5% loss
18 GB
Q5_K_M
Good quality/size compromise
22 GB
Q8_0
Nearly indistinguishable from FP16
33 GB
FP16
Full precision — server use
61 GB
Fallback CPU · If you don't have a GPU, allow 40 GB of RAM minimum to run this model at reduced speed.

What hardware do you need for North Mini Code 1.0?

To run North Mini Code 1.0 locally with Q4 quantization, you need about 18 GB of VRAM. An option to compare: GMKtec EVO-X2 64GB / 1TB (Ryzen AI Max+ 395) — leave some headroom for the system and context; check engine compatibility with the GPU.

Current offer: GMKtec EVO-X2 64GB / 1TB (Ryzen AI Max+ 395)
AmazonSee price →

Why this choice? Our complete guide on GMKtec EVO-X2 64GB / 1TB (Ryzen AI Max+ 395) →

Affiliate links — commission possible at no extra cost to you; independent recommendations. As an Amazon Associate, BestLLMfor earns from qualifying purchases.

On the go: North Mini Code 1.0 also runs on a RTX laptop PC (24 GB of VRAM) →

03Expected speed

Tokens generated per second in Q4_K_M, 4k context. Beyond 20 t/s, reading is comfortable. Below 10 t/s, that's just for testing.

Entry-level
~9t/s
GTX 1650, RX 6600, MBA M2 8GB
Mid-range
~14t/s
RTX 4060, 4070, MBP M3 Pro
High-end
~22t/s
RTX 4090, M4 Max, Radeon 7900