BestLLMfor EN Your hardware. Your LLM. Your call.
APIOpen data Find my LLM
Model fiche

Teuken 7B Instruct

By OpenGPT-X · Germany

chat general multilingual fr
Parameters
7B
License
Apache 2.0 (commercial)
Context
4k
VRAM (Q4)
5 GB
Released
November 2024

Overview

A German government-funded (BMWK) 7B from OpenGPT-X covering all 24 EU languages. The commercial variant is Apache 2.0; the research-v0.4 variant has restricted terms.

When to pick this model

  • You need EU sovereignty credentials with German institutional backing
  • You're building products across all 24 EU languages
  • You need an Apache-licensed European 7B for commercial deployment
  • You're working on public-sector or DACH-region projects

VRAM requirements by quantization

QuantizationVRAM required
Q4_K_M (recommended)5 GB
Q5_K_M6 GB
Q8_09 GB
FP16 (no quantization)14 GB

VRAM figures include model weights plus a typical 8k KV cache and ~600 MB runtime overhead (Ollama / llama.cpp baseline). Add headroom for higher context lengths.

Strengths

  • Built for EU sovereignty
  • Covers all 24 official EU languages
  • Apache 2.0 commercial variant available
  • German government (BMWK) backing

Limitations

  • Only 4K context
  • No official Ollama tag
  • Research-v0.4 variant carries a restricted license — check which you grabbed

Architecture & training

Architecture: Dense · 32 layers · GQA (2 groups) · SwiGLU · RoPE · multilingual tokenizer

Training: 24 EU languages corpus, funded by BMWK (Germany).

Verdict

An EU sovereignty pick with the commercial variant clearly licensed — confirm which variant you're using.

Quick start

# HuggingFace : openGPT-X/Teuken-7B-instruct-commercial-v0.4

Or use the open-source MCP server to query this model from Claude Desktop, Cursor, or any MCP-compatible client.

Tools

Is Teuken 7B Instruct the right pick for you?

Compute self-hosted ROI → Back to catalog