Skip to content

Qwen3-16B-A3B-bf16

mlx-community/Qwen3-16B-A3B-bf16
bf16 Open on Hugging Face
Parameters
16B
Weights (est.)
≈ 32.1 GB
Mac memory (est.)
48 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Qwen3-16B-A3B-bf16 --prompt "Hello"

Details

Base model
kalomaze/Qwen3-16B-A3B (finetune)
Vendor
kalomaze
Task
Text generation
Quantisation
bf16
Licence
apache-2.0
Downloads
53 in the last 30 days · 918 all time · 0 likes
Published
2025-05-03 · updated 2025-05-03 (1y ago)
Tags
qwen3_moe