Family Lucie · 7B parameters★ Made in France

Lucie 7B

Sovereign French-language LLM, trained on French corpora.

🇫🇷 OpenLLM-France·License Apache 2.0·Context 4k tokens·Output January 2025·Fits within the 128 GB of the GIGABYTE AI TOP ATOM← Catalog

01What it can do

Strengths
  • Full French sovereignty
  • Public training data
  • Excellent in formal French
  • Public support (CNRS, LINAGORA)
Limitations to know
  • —4k context only
  • —Less versatile than Mistral in English
Architecture
Llama-like · 32 layers · trained on Jean Zay (CNRS)
Training
OpenLLM-France project · 100% transparent corpus, high FR proportion.
Ideal for
Formal FrenchLocal content

05Install

Install Ollama for your OS. Check the model and its quantization before downloading. Start with 4096 tokens of context, then check placement with ollama ps. A command below is not proof that a test was run on your machine.

$ollama run lucie:7b
⚠
First download: between 2 and 40 GB depending on the selected quantization. Plan for sufficient disk space; a stable connection is recommended. Subsequent launches are instant.

02Required memory

Approximate GPU VRAM required to run this model, including 4k tokens of context overhead. For a longer context, add ~1 GB per 8k-token increment.

Q4_K_M
The lightest, ~5% loss
5 GB
Q5_K_M
Good quality/size compromise
6 GB
Q8_0
Nearly indistinguishable from FP16
9 GB
FP16
Full precision — server use
16 GB
Fallback CPU · If you don't have a GPU, allow 8 GB of RAM minimum to run this model at reduced speed.

What hardware do you need for Lucie 7B?

To run Lucie 7B locally with Q4 quantization, you need about 5 GB of VRAM. An option to compare: RTX 5060 Ti 16GB (ASUS Prime) — leave some headroom for the system and context; check engine compatibility with the GPU.

Current offer: RTX 5060 Ti 16GB (ASUS Prime)
AmazonSee price →

Affiliate links — commission possible at no extra cost to you; independent recommendations. As an Amazon Associate, BestLLMfor earns from qualifying purchases.

On the go: Lucie 7B also runs on a RTX laptop PC (16 GB of VRAM) →

This model in your private ChatGPT, without the cloud

Your private ChatGPT, free, on your own machine in an hour — LM Studio, Ollama, Open WebUI, your documents, no cloud.

  • Lifetime online access
  • PDF + files
  • Lifetime updates

03Expected speed

Tokens generated per second in Q4_K_M, 4k context. Beyond 20 t/s, reading is comfortable. Below 10 t/s, that's just for testing.

Entry-level
~12t/s
GTX 1650, RX 6600, MBA M2 8GB
Mid-range
~35t/s
RTX 4060, 4070, MBP M3 Pro
High-end
~90t/s
RTX 4090, M4 Max, Radeon 7900

04Public benchmarks

Scores reproduced from model cards or MMLU-Pro / community sources. Unit: % correct answers.

MMLU (fr)
54.2
FrenchBench
68