Skip to content

Muse-Glimmer-30B-6bit

mlx-community/Muse-Glimmer-30B-6bit
6-bit Open on Hugging Face
Parameters
30B
Weights (est.)
≈ 26.4 GB
Mac memory (est.)
32 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-vlm on an Apple silicon Mac:

pip install mlx-vlmpython -m mlx_vlm.generate --model mlx-community/Muse-Glimmer-30B-6bit --image photo.jpg --prompt "Describe this image"

Details

Base model
meta-models/Muse-Glimmer-30B (quantized)
Vendor
meta-models
Task
Vision + text
Quantisation
6-bit
Licence
apache-2.0
Downloads
396 in the last 30 days · 2.9K all time · 0 likes
Published
2026-08-10 · updated 2026-08-10 (3mo ago)
Tags
muse_glimmer

Other MLX builds of meta-models/Muse-Glimmer-30B

Build Quantisation Weights Mac memory Downloads
Muse-Glimmer-30B-4bit 4-bit ≈ 19.4 GB 24 GB+ 9.5K
Muse-Glimmer-30B-mxfp4 MXFP4 ≈ 19.4 GB 24 GB+ 881
Muse-Glimmer-30B-nvfp4 4-bit ≈ 19.4 GB 24 GB+ 360
Muse-Glimmer-30B-OptiQ-4bit 4-bit ≈ 19.5 GB 24 GB+ 1.8K
Muse-Glimmer-30B-5bit 5-bit ≈ 22.9 GB 32 GB+ 181
Muse-Glimmer-30B-6bit (this one) 6-bit ≈ 26.4 GB 32 GB+ 396
Muse-Glimmer-30B-8bit 8-bit ≈ 33.4 GB 48 GB+ 1.7K
Muse-Glimmer-30B-mxfp8 MXFP8 ≈ 33.4 GB 48 GB+ 141
Muse-Glimmer-30B-bf16 bf16 ≈ 59.6 GB 96 GB+ 2.0K