Skip to content

gemma-3-27b-it-qat-bf16

mlx-community/gemma-3-27b-it-qat-bf16
Vision + text · transformers
bf16 Open on Hugging Face
Parameters
—
Weights (est.)
—
Mac memory (est.)
—

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-vlm on an Apple silicon Mac:

pip install mlx-vlmpython -m mlx_vlm.generate --model mlx-community/gemma-3-27b-it-qat-bf16 --image photo.jpg --prompt "Describe this image"

Details

Base model
google/gemma-3-27b-it (finetune)
Vendor
Google · Gemma
Task
Vision + text
Quantisation
bf16
Licence
gemma
Downloads
40 in the last 30 days · 7.9K all time · 6 likes
Published
2025-04-15 · updated 2025-04-18 (1y ago)
Tags
gemma3, gemma, google

Other MLX builds of google/gemma-3-27b-it

Build Quantisation Weights Mac memory Downloads
Gemma-SEA-LION-v4-27B-IT-mlx-4bit 4-bit ≈ 5.3 GB 8 GB+ 24
gemma-3-27b-it-4bit-DWQ 4-bit DWQ ≈ 16.0 GB 24 GB+ 53
gemma-3-27b-it-qat-bf16 (this one) bf16 — — 40