Mistral-Small-4-119B-2603-OptiQ-2bit

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Mistral-Small-4-119B-2603-OptiQ-2bit --prompt "Hello"

Details

Base model

mistralai/Mistral-Small-4-119B-2603 (quantized)

Vendor

Mistral

Task

Text generation

Quantisation

2-bit

Licence

apache-2.0

Downloads

1.3K in the last 30 days · 4.7K all time · 2 likes

Published

2026-07-24 · updated 2026-09-24 (1mo ago)

Languages

en, fr, de, es, pt, it, ja, ko, ru, zh, ar, fa, id, ms, ne, pl, ro, sr, sv, tr, uk, vi, hi, bn

Tags

mistral3, optiq