Skip to content

gemma-3-4b-it-wikisql-finetuned-4bit

mlx-community/gemma-3-4b-it-wikisql-finetuned-4bit
4-bit Open on Hugging Face
Parameters
4.6B
Weights (est.)
≈ 2.6 GB
Mac memory (est.)
8 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/gemma-3-4b-it-wikisql-finetuned-4bit --prompt "Hello"

Details

Base model
mlx-community/gemma-3-4b-it-qat-4bit (finetune)
Vendor
—
Task
Text generation
Quantisation
4-bit
Licence
qwen
Downloads
65 in the last 30 days · 640 all time · 0 likes
Published
2025-08-30 · updated 2025-08-30 (1y ago)
Languages
multilingual
Tags
gemma3, internvl, custom_code