Skip to content
Apple silicon

Apple MLX models

5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 2h ago. Weights size and Mac memory are estimates from parameter count and quantisation.

Alert me about new Apple/MLX models

5,841 builds · page 37 of 98

Phi-3-mini-4k-instruct-8bit

mlx-community/Phi-3-mini-4k-instruct-8bit
8-bit
Text generation ↓ 90 · ♥ 2
Params
3.8B
Weights
≈ 4.1 GB
Mac memory
8 GB+

mit · updated 2024-07-04

Baichuan-M1-14B-Instruct-4bit

from baichuan-inc/Baichuan-M1-14B-Instruct
4-bit
Text generation · baichuan-inc ↓ 90 · ♥ 1
Params
14B
Weights
≈ 8.1 GB
Mac memory
16 GB+

updated 2025-04-25

CodeLlama-7b-Python-hf-8bit-mlx

mlx-community/CodeLlama-7b-Python-hf-8bit-mlx
8-bit
Text generation ↓ 90 · ♥ 1
Params
—
Weights
—
Mac memory
—

llama2 · updated 2024-01-04

Irodori-TTS-v4-Large-8bit

from Aratako/Irodori-TTS-v4-Large
8-bit
Text to speech · Aratako ↓ 90 · ♥ 0
Params
3.3B
Weights
≈ 4.0 GB
Mac memory
8 GB+

updated 2026-10-04

MiMo-VL-7B-RL-4bit

from XiaomiMiMo/MiMo-VL-7B-RL
4-bit
Vision + text · XiaomiMiMo ↓ 90 · ♥ 0
Params
8.3B
Weights
≈ 4.7 GB
Mac memory
8 GB+

mit · updated 2025-05-31

NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-5Bit

from nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
5-bit
Text generation · NVIDIA ↓ 90 · ♥ 0
Params
5.9B
Weights
≈ 5.4 GB
Mac memory
16 GB+

nvidia-open-model-license · updated 2025-12-17

Qwen3-4B-Instruct-2507-4bit-g32

from Qwen/Qwen3-4B-Instruct-2507
4-bit
Text generation · Qwen ↓ 90 · ♥ 0
Params
4.0B
Weights
≈ 2.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-11

gemma-3-1b-it-abliterated-4bit

from mlabonne/gemma-3-1b-it-abliterated
4-bit
Text generation · mlabonne ↓ 90 · ♥ 0
Params
1.3B
Weights
≈ 732 MB
Mac memory
8 GB+

gemma · updated 2025-03-22

granite-4.0-tiny-preview-4bit

from ibm-granite/granite-4.0-tiny-preview
4-bit
Text generation · IBM · Granite ↓ 90 · ♥ 0
Params
6.7B
Weights
≈ 3.8 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-09-10

Qwen3-235B-A22B-Instruct-2507-3bit-DWQ

from mlx-community/Qwen3-235B-A22B-Instruct-2507-8bit
3-bit DWQ
Text generation ↓ 89 · ♥ 6
Params
235B
Weights
≈ 103 GB
Mac memory
128 GB+

apache-2.0 · updated 2025-07-26

VoxCPM1.5

from openbmb/MiniCPM4-0.5B
Text to speech · openbmb ↓ 89 · ♥ 4
Params
888M
Weights
≈ 1.9 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-12-10

TinyMistral-248M-4bits

mlx-community/TinyMistral-248M-4bits
4-bit
Text generation ↓ 89 · ♥ 1
Params
248M
Weights
≈ 140 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-06-28

DeepSeek-R1-Distill-Qwen-1.5B-6bit

from deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
6-bit
Uncategorised · DeepSeek ↓ 89 · ♥ 0
Params
1.8B
Weights
≈ 1.4 GB
Mac memory
8 GB+

updated 2025-02-26

GLM-Z1-9B-0414-abliterated-4bit

from huihui-ai/GLM-Z1-9B-0414-abliterated
4-bit
Text generation · huihui-ai ↓ 89 · ♥ 0
Params
9.4B
Weights
≈ 5.3 GB
Mac memory
8 GB+

mit · updated 2025-04-26

Josiefied-Qwen2.5-3B-Instruct-abliterated-v1-8-bit

from Goekdeniz-Guelmez/Josiefied-Qwen2.5-3B-Instruct-abliterated-v1
8-bit
Text generation · Goekdeniz-Guelmez ↓ 89 · ♥ 0
Params
3.1B
Weights
≈ 3.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-12-20

Qwen2.5-VL-72B-Instruct-bf16

from Qwen/Qwen2.5-VL-72B-Instruct
bf16
Vision + text · Qwen ↓ 89 · ♥ 0
Params
73B
Weights
≈ 147 GB
Mac memory
192 GB+

qwen · updated 2025-02-25

granite-3.3-2b-instruct-8bit

from ibm-granite/granite-3.3-2b-instruct
8-bit
Text generation · IBM · Granite ↓ 89 · ♥ 0
Params
2.5B
Weights
≈ 2.7 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-04-16

whisper-small-asr-8bit

mlx-community/whisper-small-asr-8bit
8-bit
Speech recognition ↓ 89 · ♥ 0
Params
241M
Weights
≈ 258 MB
Mac memory
8 GB+

apache-2.0 · updated 2026-01-15

Ornith-1.0-35B-8bit

from ornith-ai/Ornith-1.0-35B
8-bit
Vision + text · ornith-ai ↓ 88 · ♥ 9
Params
35B
Weights
≈ 37.7 GB
Mac memory
48 GB+

mit · updated 2026-06-27

Qwen2-VL-72B-Instruct-4bit

mlx-community/Qwen2-VL-72B-Instruct-4bit
4-bit
Vision + text ↓ 88 · ♥ 5
Params
73B
Weights
≈ 41.3 GB
Mac memory
64 GB+

tongyi-qianwen · updated 2025-03-24

Qwen2.5-14B-Instruct-bf16

from Qwen/Qwen2.5-14B
bf16
Text generation · Qwen ↓ 88 · ♥ 2
Params
15B
Weights
≈ 29.5 GB
Mac memory
48 GB+

apache-2.0 · updated 2024-09-18

Mistral-Small-24B-Instruct-2501-writer

from lars1234/Mistral-Small-24B-Instruct-2501-writer
6-bit
Text generation · lars1234 ↓ 88 · ♥ 1
Params
24B
Weights
≈ 19.2 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-06-23

Step-3.5-Flash-6bit

from stepfun-ai/Step-3.5-Flash
6-bit
Text generation · stepfun-ai ↓ 88 · ♥ 1
Params
197B
Weights
≈ 160 GB
Mac memory
192 GB+

apache-2.0 · updated 2026-02-04

gemma-4-E4B-it-qat-6bit

mlx-community/gemma-4-E4B-it-qat-6bit
6-bit
Vision + text ↓ 88 · ♥ 1
Params
7.9B
Weights
≈ 7.0 GB
Mac memory
16 GB+

updated 2026-06-05

parakeet-rnnt-1.1b

from nvidia/parakeet-rnnt-1.1b
Speech recognition · NVIDIA ↓ 88 · ♥ 1
Params
1.1B
Weights
≈ 4.3 GB
Mac memory
8 GB+

cc-by-4.0 · updated 2025-05-10

Dolphin3.0-Llama3.1-8B-8bit

from dphn/Dolphin3.0-Llama3.1-8B
8-bit
Uncategorised · dphn ↓ 88 · ♥ 0
Params
8.0B
Weights
≈ 8.5 GB
Mac memory
16 GB+

llama3.1 · updated 2025-01-05

K2-Horizon-0.9B-4bit

from IFM/K2-Horizon-0.9B
4-bit
Text generation · IFM ↓ 88 · ♥ 0
Params
1.1B
Weights
≈ 607 MB
Mac memory
8 GB+

apache-2.0 · updated 2026-09-30

Qwen3-1.7B-3bit

from Qwen/Qwen3-1.7B
3-bit
Text generation · Qwen ↓ 88 · ♥ 0
Params
1.7B
Weights
≈ 753 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-04-28

YuE2-Vae-fp32

from m-a-p/YuE2-Vae
fp32
Text to audio · m-a-p ↓ 88 · ♥ 0
Params
—
Weights
—
Mac memory
—

cc-by-nc-4.0 · updated 2026-10-28

dolphin-2.9.4-llama3.1-8b-4bit

from dphn/dolphin-2.9.4-llama3.1-8b
4-bit
Uncategorised · dphn ↓ 88 · ♥ 0
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

llama3.1 · updated 2024-10-21

sarashina2.2-3b-instruct-v0.1-8bit

from sbintuitions/sarashina2.2-3b-instruct-v0.1
8-bit
Text generation · sbintuitions ↓ 88 · ♥ 0
Params
3.4B
Weights
≈ 3.6 GB
Mac memory
8 GB+

mit · updated 2025-03-05

tiny-aya-fire

from CohereLabs/tiny-aya-fire
Text generation · Cohere ↓ 88 · ♥ 0
Params
3.3B
Weights
≈ 6.7 GB
Mac memory
16 GB+

cc-by-nc-4.0 · updated 2026-03-05

whisper-small.en-mlx-8bit

mlx-community/whisper-small.en-mlx-8bit
8-bit
Uncategorised ↓ 88 · ♥ 0
Params
—
Weights
—
Mac memory
—

updated 2024-03-09

DeepSeek-R1-0528-Qwen3-8B-bf16

from deepseek-ai/deepseek-r1-0528-Qwen3-8B
bf16
Text generation · DeepSeek ↓ 87 · ♥ 4
Params
8.2B
Weights
≈ 16.4 GB
Mac memory
24 GB+

mit · updated 2025-05-29

medgemma-4b-it-8bit

from google/medgemma-4b-pt
8-bit
Vision + text · Google · Gemma ↓ 87 · ♥ 3
Params
4.6B
Weights
≈ 4.8 GB
Mac memory
8 GB+

health-ai-developer-foundations · updated 2025-06-09

3b-de-ft-research_release-bf16

from canopylabs/orpheus-3b-0.1-pretrained
bf16
Text to speech · canopylabs ↓ 87 · ♥ 0
Params
—
Weights
—
Mac memory
—

apache-2.0 · updated 2025-04-09

Falcon-H1-3B-Instruct-4bit

from tiiuae/Falcon-H1-3B-Instruct
4-bit
Text generation · TII · Falcon ↓ 87 · ♥ 0
Params
3.1B
Weights
≈ 1.8 GB
Mac memory
8 GB+

falcon-llm-license · updated 2025-06-16

WhiteRabbitNeo-2.5-Qwen-2.5-Coder-12.3B

from win10/WhiteRabbitNeo-2.5-Qwen-2.5-Coder-12.3B
4-bit
Text generation · win10 ↓ 87 · ♥ 0
Params
12B
Weights
≈ 6.9 GB
Mac memory
16 GB+

updated 2025-03-01

gemma-4-12B-it-qat-assistant-bf16

from google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
bf16
Text generation · Google · Gemma ↓ 87 · ♥ 0
Params
423M
Weights
≈ 846 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

magnum-v3-34b-4bit

from anthracite-org/magnum-v3-34b
4-bit
Text generation · anthracite-org ↓ 87 · ♥ 0
Params
34B
Weights
≈ 19.3 GB
Mac memory
24 GB+

apache-2.0 · updated 2024-12-14

Ornith-1.0-9B-6bit

from ornith-ai/Ornith-1.0-9B
6-bit
Text generation · ornith-ai ↓ 86 · ♥ 6
Params
9.4B
Weights
≈ 8.2 GB
Mac memory
16 GB+

mit · updated 2026-06-28

Qwen3-32B-6bit

from Qwen/Qwen3-32B
6-bit
Text generation · Qwen ↓ 86 · ♥ 1
Params
33B
Weights
≈ 26.6 GB
Mac memory
32 GB+

apache-2.0 · updated 2025-04-28

Qwen3.5-122B-A10B-6bit-gs32

from Qwen/Qwen3.5-122B-A10B
6-bit
Vision + text · Qwen ↓ 86 · ♥ 1
Params
123B
Weights
≈ 100 GB
Mac memory
128 GB+

apache-2.0 · updated 2026-05-02

Hermes-4-14B-6bit

from NousResearch/Hermes-4-14B
6-bit
Text generation · NousResearch ↓ 86 · ♥ 0
Params
15B
Weights
≈ 12.0 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-09-03

MiMo-VL-7B-RL-8bit

from XiaomiMiMo/MiMo-VL-7B-RL
8-bit
Vision + text · XiaomiMiMo ↓ 86 · ♥ 0
Params
—
Weights
—
Mac memory
—

mit · updated 2025-05-31

Mistral-Small-24B-Instruct-2501-abliterated

from huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated
Text generation · huihui-ai ↓ 86 · ♥ 0
Params
24B
Weights
≈ 47.1 GB
Mac memory
64 GB+

apache-2.0 · updated 2025-02-20

Molmo2-8B-8bit

from Qwen/Qwen3-8B
8-bit
Video + text · Qwen ↓ 86 · ♥ 0
Params
8.7B
Weights
≈ 10.2 GB
Mac memory
16 GB+

apache-2.0 · updated 2026-01-11

Qwen2.5-Coder-0.5B-bf16

from Qwen/Qwen2.5-Coder-0.5B
bf16
Text generation · Qwen ↓ 86 · ♥ 0
Params
494M
Weights
≈ 988 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-11-11

bigcode-starcoder2-15b-fp16

from bigcode/starcoder2-15b
fp16
Text generation · BigCode ↓ 86 · ♥ 0
Params
16B
Weights
≈ 31.9 GB
Mac memory
48 GB+

bigcode-openrail-m · updated 2025-02-16

gemma-3-1b-it-abliterated-8bit

from mlabonne/gemma-3-1b-it-abliterated
8-bit
Text generation · mlabonne ↓ 86 · ♥ 0
Params
1.3B
Weights
≈ 1.4 GB
Mac memory
8 GB+

gemma · updated 2025-03-22

parakeet-rnnt-0.6b

from nvidia/parakeet-rnnt-0.6b
Speech recognition · NVIDIA ↓ 86 · ♥ 0
Params
617M
Weights
≈ 2.5 GB
Mac memory
8 GB+

cc-by-4.0 · updated 2025-05-10

whisper-small-khmer-mlx-fp16

from openai-whisper-small
fp16
Speech recognition ↓ 86 · ♥ 0
Params
241M
Weights
≈ 481 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-25

DeepSeek-R1-Distill-Qwen-7B-6bit

from deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
6-bit
Uncategorised · DeepSeek ↓ 85 · ♥ 2
Params
7.6B
Weights
≈ 6.2 GB
Mac memory
16 GB+

updated 2025-02-26

LFM2-8B-A1B-3bit-MLX

from LiquidAI/LFM2-8B-A1B
3-bit
Text generation · LiquidAI ↓ 85 · ♥ 2
Params
8.3B
Weights
≈ 3.6 GB
Mac memory
8 GB+

lfm1.0 · updated 2025-10-08

aya-23-8B-4bit

mlx-community/aya-23-8B-4bit
4-bit
Text generation ↓ 85 · ♥ 2
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

cc-by-nc-4.0 · updated 2024-05-23

gemma-3-4b-pt-bf16

mlx-community/gemma-3-4b-pt-bf16
bf16
Vision + text ↓ 85 · ♥ 2
Params
5.0B
Weights
≈ 9.9 GB
Mac memory
16 GB+

gemma · updated 2025-03-18

Devstral-Small-2507-5bit

from mlx-community/Devstral-Samll-2507-bf16
5-bit
Text generation ↓ 85 · ♥ 1
Params
24B
Weights
≈ 16.2 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-07-11