Skip to content

Ministral-3-8B-Reasoning-2512-bf16

mlx-community/Ministral-3-8B-Reasoning-2512-bf16
Uncategorised · vllm
bf16 Open on Hugging Face
Parameters
8.9B
Weights (est.)
≈ 17.8 GB
Mac memory (est.)
24 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
mistralai/Ministral-3-8B-Base-2512 (finetune)
Vendor
Mistral
Task
Uncategorised
Quantisation
bf16
Licence
apache-2.0
Downloads
34 in the last 30 days · 1.1K all time · 0 likes
Published
2025-12-03 · updated 2025-12-03 (11mo ago)
Languages
en, fr, es, de, it, pt, nl, zh, ja, ko, ar
Tags
vllm, mistral3, mistral-common

Other MLX builds of mistralai/Ministral-3-8B-Base-2512

Build Quantisation Weights Mac memory Downloads
Ministral-3-8B-Base-2512-4bit 4-bit ≈ 4.8 GB 8 GB+ 107
Ministral-3-8B-Base-2512-6bit 6-bit ≈ 8.4 GB 16 GB+ 39
Ministral-3-8B-Base-2512-8bit 8-bit ≈ 10.4 GB 16 GB+ 53
Ministral-3-8B-Base-2512-bf16 bf16 ≈ 17.8 GB 24 GB+ 53
Ministral-3-8B-Reasoning-2512-bf16 (this one) bf16 ≈ 17.8 GB 24 GB+ 34
Ministral-3-8B-Instruct-2512-4bit 4-bit — — 3.6K
Ministral-3-8B-Reasoning-2512-4bit 4-bit — — 223
Ministral-3-8B-Instruct-2512-8bit 8-bit — — 170
Ministral-3-8B-Instruct-2512-6bit 6-bit — — 128
Ministral-3-8B-Reasoning-2512-8bit 8-bit — — 71
Ministral-3-8B-Instruct-2512-bf16 bf16 — — 61
Ministral-3-8B-Reasoning-2512-6bit 6-bit — — 56
Ministral-3-8B-Instruct-2512-5bit 5-bit — — 48
Ministral-3-8B-Reasoning-2512-5bit 5-bit — — 42