Skip to content

Qwen3.5-9B-MLX-bf16

mlx-community/Qwen3.5-9B-MLX-bf16
Uncategorised · mlx
bf16 Open on Hugging Face
Parameters
9.4B
Weights (est.)
≈ 18.8 GB
Mac memory (est.)
24 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
Qwen/Qwen3.5-9B (finetune) · Qwen3.5 9B on the radar →
Vendor
Qwen
Task
Uncategorised
Quantisation
bf16
Licence
apache-2.0
Downloads
136 in the last 30 days · 2.9K all time · 2 likes
Published
2026-03-02 · updated 2026-03-02 (8mo ago)
Tags
qwen3_5, qwen3.5, vision-language-model, bf16, bfloat16

Other MLX builds of Qwen/Qwen3.5-9B

Build Quantisation Weights Mac memory Downloads
Qwen3.5-9B-MTP-4bit 4-bit ≈ 137 MB 8 GB+ 1.0K
Qwen3.5-9B-MTP-5bit 5-bit ≈ 167 MB 8 GB+ 128
Qwen3.5-9B-MTP-bf16 bf16 ≈ 487 MB 8 GB+ 140
Ternary-Bonsai-2-9B-2bit 2-bit ≈ 3.7 GB 8 GB+ 897
Qwen3.5-9B-MLX-4bit 4-bit ≈ 6.0 GB 16 GB+ 27K
Qwen3.5-9B-OptiQ-4bit 4-bit ≈ 6.0 GB 16 GB+ 6.5K
Qwen3.5-9B-MLX-8bit 8-bit ≈ 10.4 GB 16 GB+ 1.4K
Qwen3.5-9B-MLX-bf16 (this one) bf16 ≈ 18.8 GB 24 GB+ 136