Skip to content

Mistral-Small-4-119B-2603-5bit

mlx-community/Mistral-Small-4-119B-2603-5bit
Uncategorised · mlx
5-bit Open on Hugging Face
Parameters
119B
Weights (est.)
≈ 82.6 GB
Mac memory (est.)
96 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
—
Vendor
—
Task
Uncategorised
Quantisation
5-bit
Licence
apache-2.0
Downloads
172 in the last 30 days · 3.2K all time · 0 likes
Published
2026-03-17 · updated 2026-03-18 (7mo ago)
Languages
en, fr, de, es, pt, it, ja, ko, ru, zh, ar, fa, id, ms, ne, pl, ro, sr, sv, tr, uk, vi, hi, bn
Tags
mistral3, vLLM