Skip to content

Magistral-Small-2506-bf16

mlx-community/Magistral-Small-2506-bf16
bf16 Open on Hugging Face
Parameters
24B
Weights (est.)
≈ 47.1 GB
Mac memory (est.)
64 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Magistral-Small-2506-bf16 --prompt "Hello"

Details

Base model
mistralai/Magistral-Small-2506 (finetune)
Vendor
Mistral
Task
Text generation
Quantisation
bf16
Licence
apache-2.0
Downloads
46 in the last 30 days · 1.7K all time · 10 likes
Published
2025-06-10 · updated 2025-06-10 (1y ago)
Languages
en, fr, de, es, pt, it, ja, ko, ru, zh, ar, fa, id, ms, ne, pl, ro, sr, sv, tr, uk, vi, hi, bn
Tags
mistral