Skip to content

translategemma-12b-it-6bit

mlx-community/translategemma-12b-it-6bit
6-bit Open on Hugging Face
Parameters
12B
Weights (est.)
≈ 9.6 GB
Mac memory (est.)
16 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
google/translategemma-12b-it (quantized)
Vendor
Google · Gemma
Task
Translation
Quantisation
6-bit
Licence
gemma
Downloads
108 in the last 30 days · 734 all time · 0 likes
Published
2026-07-22 · updated 2026-07-22 (3mo ago)
Tags
gemma3

Other MLX builds of google/translategemma-12b-it

Build Quantisation Weights Mac memory Downloads
translategemma-12b-it-4bit 4-bit ≈ 6.6 GB 16 GB+ 1.5K
translategemma-12b-it-6bit (this one) 6-bit ≈ 9.6 GB 16 GB+ 108
translategemma-12b-it-8bit 8-bit ≈ 12.5 GB 16 GB+ 1.1K