Skip to content

Qwen3.5-122B-A10B-OptiQ-2bit

mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit
2-bit Open on Hugging Face
Parameters
122B
Weights (est.)
≈ 39.1 GB
Mac memory (est.)
48 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-vlm on an Apple silicon Mac:

pip install mlx-vlmpython -m mlx_vlm.generate --model mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit --image photo.jpg --prompt "Describe this image"

Details

Base model
Qwen/Qwen3.5-122B-A10B (quantized)
Vendor
Qwen
Task
Vision + text
Quantisation
2-bit
Licence
apache-2.0
Downloads
353 in the last 30 days · 3.6K all time · 6 likes
Published
2026-06-19 · updated 2026-09-15 (1mo ago)
Tags
qwen3_5_moe, quantized, 2bit, mixed-precision, optiq, static, ssd-streaming, apple-silicon, vision

Other MLX builds of Qwen/Qwen3.5-122B-A10B

Build Quantisation Weights Mac memory Downloads
Qwen3.5-122B-A10B-OptiQ-2bit (this one) 2-bit ≈ 39.1 GB 48 GB+ 353
Qwen3.5-122B-A10B-heretic-v2-2.34bit-msq 34-bit ≈ 43.3 GB 64 GB+ 84
Qwen3.5-122B-A10B-mxfp4 MXFP4 ≈ 69.6 GB 96 GB+ 126
Qwen3.5-122B-A10B-6bit-gs32 6-bit ≈ 100 GB 128 GB+ 86
Qwen3.5-122B-A10B-mxfp8 MXFP8 ≈ 131 GB 192 GB+ 791