Skip to content

gemma-4-26B-A4B-it-qat-nvfp4

mlx-community/gemma-4-26B-A4B-it-qat-nvfp4
4-bit Open on Hugging Face
Parameters
26B
Weights (est.)
≈ 15.3 GB
Mac memory (est.)
24 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-vlm on an Apple silicon Mac:

pip install mlx-vlmpython -m mlx_vlm.generate --model mlx-community/gemma-4-26B-A4B-it-qat-nvfp4 --image photo.jpg --prompt "Describe this image"

Details

Base model
—
Vendor
—
Task
Vision + text
Quantisation
4-bit
Licence
—
Downloads
152 in the last 30 days · 3.8K all time · 3 likes
Published
2026-06-05 · updated 2026-06-05 (5mo ago)
Languages
en
Tags
gemma4