gemma-3-12b-it-qat-abliterated-lm-4bit
from mlabonne/gemma-3-12b-it-qat-abliterated
Params
12B
Weights
≈ 6.6 GB
Mac memory
16 GB+
gemma · updated 2025-09-29
Apple silicon
Apple MLX models
5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 1h ago. Weights size and Mac memory are estimates from parameter count and quantisation.
Alert me about new Apple/MLX models
10 builds · clear filters
Meta-Llama-3.1-8B-Instruct-abliterated
from mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
Params
8.0B
Weights
≈ 16.1 GB
Mac memory
24 GB+
llama3.1 · updated 2024-09-28
gemma-3-4b-it-abliterated-4bit-text
from mlabonne/gemma-3-4b-it-abliterated
Params
4.6B
Weights
≈ 2.6 GB
Mac memory
8 GB+
gemma · updated 2025-03-22
gemma-3-1b-it-abliterated-4bit
from mlabonne/gemma-3-1b-it-abliterated
Params
1.3B
Weights
≈ 732 MB
Mac memory
8 GB+
gemma · updated 2025-03-22
gemma-3-1b-it-abliterated-8bit
from mlabonne/gemma-3-1b-it-abliterated
Params
1.3B
Weights
≈ 1.4 GB
Mac memory
8 GB+
gemma · updated 2025-03-22
gemma-3-4b-it-abliterated-6bit-text
from mlabonne/gemma-3-4b-it-abliterated
Params
4.6B
Weights
≈ 3.7 GB
Mac memory
8 GB+
gemma · updated 2025-03-22
gemma-3-4b-it-abliterated-8bit-text
from mlabonne/gemma-3-4b-it-abliterated
Params
4.6B
Weights
≈ 4.8 GB
Mac memory
8 GB+
gemma · updated 2025-03-22
gemma-3-4b-it-abliterated-bf16-text
from mlabonne/gemma-3-4b-it-abliterated
Params
4.6B
Weights
≈ 9.1 GB
Mac memory
16 GB+
gemma · updated 2025-03-22
gemma-3-1b-it-abliterated-6bit
from mlabonne/gemma-3-1b-it-abliterated
Params
1.3B
Weights
≈ 1.1 GB
Mac memory
8 GB+
gemma · updated 2025-03-22
gemma-3-1b-it-abliterated-bf16
from mlabonne/gemma-3-1b-it-abliterated
Params
1.3B
Weights
≈ 2.6 GB
Mac memory
8 GB+
gemma · updated 2025-03-22