Skip to content
AI Model Radar
Apple silicon

Apple MLX models

5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 2h ago. Weights size and Mac memory are estimates from parameter count and quantisation.

Alert me about new Apple/MLX models

2,922 builds · page 17 of 49 · clear filters

CodeLlama-70b-hf-4bit-MLX

mlx-community/CodeLlama-70b-hf-4bit-MLX
4-bit
Text generation ↓ 96 · ♥ 12
Params
—
Weights
—
Mac memory
—

llama2 · updated 2024-01-31

gte-Qwen2-7B-instruct-4bit-DWQ

from Alibaba-NLP/gte-Qwen2-7B-instruct
4-bit DWQ
Text generation · Alibaba-NLP ↓ 96 · ♥ 3
Params
7.6B
Weights
≈ 4.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-05-07

gemma-3-12b-it-4bit-DWQ

from google/gemma-3-12b-it
4-bit DWQ
Text generation · Google · Gemma ↓ 96 · ♥ 2
Params
13B
Weights
≈ 7.2 GB
Mac memory
16 GB+

gemma · updated 2025-05-18

Kimi-Linear-48B-A3B-Instruct-5bit

from moonshotai/Kimi-Linear-48B-A3B-Instruct
5-bit
Text generation · Moonshot · Kimi ↓ 96 · ♥ 1
Params
49B
Weights
≈ 33.8 GB
Mac memory
48 GB+

mit · updated 2026-01-22

Mistral-Small-3.2-24B-Instruct-2506-bf16

from mistralai/Mistral-Small-3.2-24B-Instruct-2506
bf16
Text generation · Mistral ↓ 96 · ♥ 1
Params
24B
Weights
≈ 47.1 GB
Mac memory
64 GB+

apache-2.0 · updated 2025-06-21

cogito-v2-preview-deepseek-671B-MoE-4bit

from deepcogito/cogito-v2-preview-deepseek-671B-MoE
4-bit
Text generation · deepcogito ↓ 96 · ♥ 1
Params
671B
Weights
≈ 378 GB
Mac memory
512 GB+

mit · updated 2025-08-02

OpenResearcher-30B-A3B-6bit

from OpenResearcher/OpenResearcher-30B-A3B
6-bit
Text generation · OpenResearcher ↓ 96 · ♥ 0
Params
32B
Weights
≈ 25.7 GB
Mac memory
32 GB+

mit · updated 2026-02-10

Qwen2.5-Coder-0.5B-Instruct-8bit

from Qwen/Qwen2.5-Coder-0.5B-Instruct
8-bit
Text generation · Qwen ↓ 96 · ♥ 0
Params
494M
Weights
≈ 525 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-11-11

bigcode-starcoder2-15b-8bit

from bigcode/starcoder2-15b
8-bit
Text generation · BigCode ↓ 96 · ♥ 0
Params
16B
Weights
≈ 17.0 GB
Mac memory
24 GB+

bigcode-openrail-m · updated 2025-02-16

starcoder2-15b-instruct-v0.1

from bigcode/starcoder2-15b
Text generation · BigCode ↓ 96 · ♥ 0
Params
16B
Weights
≈ 31.9 GB
Mac memory
48 GB+

bigcode-openrail-m · updated 2024-04-30

LongCat-Next-4bit

from meituan-longcat/LongCat-Next
4-bit
Text generation · meituan-longcat ↓ 95 · ♥ 7
Params
69B
Weights
≈ 38.6 GB
Mac memory
48 GB+

mit · updated 2026-03-26

Laguna-S-2.1-oQ5e

from poolside/Laguna-S-2.1
5-bit
Text generation · poolside ↓ 95 · ♥ 4
Params
118B
Weights
≈ 80.9 GB
Mac memory
96 GB+

openmdw-1.1 · updated 2026-07-24

DeepSeek-R1-0528-Qwen3-8B-6bit

from deepseek-ai/DeepSeek-R1-0528-Qwen3-8B
6-bit
Text generation · DeepSeek ↓ 95 · ♥ 1
Params
8.2B
Weights
≈ 6.7 GB
Mac memory
16 GB+

mit · updated 2025-06-06

DeepSeek-V3.2-Speciale-4bit

from deepseek-ai/DeepSeek-V3.2-Speciale
4-bit
Text generation · DeepSeek ↓ 95 · ♥ 1
Params
672B
Weights
≈ 378 GB
Mac memory
512 GB+

mit · updated 2025-12-03

Qwen2.5-32B-Instruct-4bit-AWQ

from Qwen/Qwen2.5-32B-Instruct
4-bit
Text generation · Qwen ↓ 95 · ♥ 1
Params
33B
Weights
≈ 18.4 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-04-26

CodeLlama-13b-Python-4bit-MLX

mlx-community/CodeLlama-13b-Python-4bit-MLX
4-bit
Text generation ↓ 95 · ♥ 0
Params
—
Weights
—
Mac memory
—

llama2 · updated 2024-01-29

Devstral-2-123B-Instruct-2512-bf16

from mistralai/Devstral-2-123B-Instruct-2512
bf16
Text generation · Mistral ↓ 95 · ♥ 0
Params
125B
Weights
≈ 250 GB
Mac memory
512 GB+

other · updated 2025-12-10

XVERSE-7B-Chat-4bit

from xverse/XVERSE-7B-Chat
4-bit
Text generation · xverse ↓ 95 · ♥ 0
Params
7.3B
Weights
≈ 4.1 GB
Mac memory
8 GB+

xverse-model-license · updated 2026-09-07

granite-4.0-h-small-4bit

from ibm-granite/granite-4.0-h-small
4-bit
Text generation · IBM · Granite ↓ 95 · ♥ 0
Params
32B
Weights
≈ 18.1 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-10-02

shisa-v2.1-llama3.3-70b-mlx-8bit

from shisa-ai/shisa-v2.1-llama3.3-70b
8-bit
Text generation · shisa-ai ↓ 95 · ♥ 0
Params
71B
Weights
≈ 75.0 GB
Mac memory
96 GB+

llama3.3 · updated 2025-12-16

Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-2-bit

from Goekdeniz-Guelmez/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2
2-bit
Text generation · Goekdeniz-Guelmez ↓ 94 · ♥ 1
Params
7.6B
Weights
≈ 2.4 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-12-08

c4ai-command-a-03-2025-4bit

from CohereLabs/c4ai-command-a-03-2025
4-bit
Text generation · Cohere ↓ 94 · ♥ 1
Params
111B
Weights
≈ 62.5 GB
Mac memory
96 GB+

cc-by-nc-4.0 · updated 2025-03-18

gemma-4-31B-it-qat-assistant-bf16

from google/gemma-4-31B-it-qat-q4_0-unquantized-assistant
bf16
Text generation · Google · Gemma ↓ 94 · ♥ 1
Params
470M
Weights
≈ 939 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

Kumru-2B-4bit

from vngrs-ai/Kumru-2B
4-bit
Text generation · vngrs-ai ↓ 94 · ♥ 0
Params
2.4B
Weights
≈ 1.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-15

Phi-3.5-mini-instruct-8bit

mlx-community/Phi-3.5-mini-instruct-8bit
8-bit
Text generation ↓ 93 · ♥ 6
Params
3.8B
Weights
≈ 4.1 GB
Mac memory
8 GB+

mit · updated 2024-08-24

Llama-3.2-1B-Instruct-MLXTuned

from meta-llama/Llama-3.2-1B-Instruct
Text generation · Meta · Llama ↓ 93 · ♥ 5
Params
1.2B
Weights
≈ 2.5 GB
Mac memory
8 GB+

llama3.2 · updated 2025-01-02

SmolLM3-3B-Base-4bit

from HuggingFaceTB/SmolLM3-3B-Base
4-bit
Text generation · Hugging Face ↓ 93 · ♥ 3
Params
3.1B
Weights
≈ 1.7 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-07-09

DeepSeek-R1-Distill-Qwen-32B-Q

from deepseek-ai/DeepSeek-R1-Distill-Qwen-32B
4-bit
Text generation · DeepSeek ↓ 93 · ♥ 2
Params
33B
Weights
≈ 18.4 GB
Mac memory
24 GB+

mit · updated 2025-06-23

LFM2-700M-8bit

from LiquidAI/LFM2-700M
8-bit
Text generation · LiquidAI ↓ 93 · ♥ 2
Params
742M
Weights
≈ 789 MB
Mac memory
8 GB+

lfm1.0 · updated 2025-07-11

Step-3.5-Flash-8bit

from stepfun-ai/Step-3.5-Flash
8-bit
Text generation · stepfun-ai ↓ 93 · ♥ 2
Params
197B
Weights
≈ 209 GB
Mac memory
256 GB+

apache-2.0 · updated 2026-02-04

DeepSeek-V4-Flash-mxfp4

mlx-community/DeepSeek-V4-Flash-mxfp4
MXFP4
Text generation ↓ 93 · ♥ 1
Params
284B
Weights
≈ 160 GB
Mac memory
192 GB+

updated 2026-04-25

Qwen2.5-14B-4bit

mlx-community/Qwen2.5-14B-4bit
4-bit
Text generation ↓ 93 · ♥ 1
Params
15B
Weights
≈ 8.3 GB
Mac memory
16 GB+

apache-2.0 · updated 2024-09-18

sarashina2.2-3b-instruct-v0.1-4bit

from sbintuitions/sarashina2.2-3b-instruct-v0.1
4-bit
Text generation · sbintuitions ↓ 93 · ♥ 1
Params
3.4B
Weights
≈ 1.9 GB
Mac memory
8 GB+

mit · updated 2025-03-05

GLM-4.7-Flash-bf16

from zai-org/GLM-4.7-Flash
bf16
Text generation · zai-org ↓ 93 · ♥ 0
Params
30B
Weights
≈ 59.9 GB
Mac memory
96 GB+

mit · updated 2026-01-25

Josiefied-Health-Qwen3-8B-abliterated-v1-8bit

from Goekdeniz-Guelmez/Josiefied-Health-Qwen3-8B-abliterated-v1
8-bit
Text generation · Goekdeniz-Guelmez ↓ 93 · ♥ 0
Params
8.2B
Weights
≈ 8.7 GB
Mac memory
16 GB+

updated 2025-06-03

Qwen2.5-7B-8bit

mlx-community/Qwen2.5-7B-8bit
8-bit
Text generation ↓ 93 · ♥ 0
Params
7.6B
Weights
≈ 8.1 GB
Mac memory
16 GB+

apache-2.0 · updated 2024-09-18

gemma-2-27b-bf16-4bit

from google/gemma-2-27b
4-bit
Text generation · Google · Gemma ↓ 93 · ♥ 0
Params
27B
Weights
≈ 15.3 GB
Mac memory
24 GB+

gemma · updated 2024-10-22

S1-mini-MLX-bf16

from superwhisper/s1-mini
bf16
Text generation · superwhisper ↓ 92 · ♥ 3
Params
596M
Weights
≈ 1.2 GB
Mac memory
8 GB+

s1-mini-license · updated 2026-08-20

LFM2.5-2.6B-nvfp4

from LiquidAI/LFM2.5-2.6B
4-bit
Text generation · LiquidAI ↓ 92 · ♥ 1
Params
2.7B
Weights
≈ 1.5 GB
Mac memory
8 GB+

lfm1.0 · updated 2026-08-13

LFM2.5-2.6B-mxfp8

from LiquidAI/LFM2.5-2.6B
MXFP8
Text generation · LiquidAI ↓ 92 · ♥ 0
Params
2.7B
Weights
≈ 2.9 GB
Mac memory
8 GB+

lfm1.0 · updated 2026-08-13

gemma-3n-E4B-it-lm-bf16

from google/gemma-3n-E4B-it
bf16
Text generation · Google · Gemma ↓ 91 · ♥ 5
Params
6.9B
Weights
≈ 13.7 GB
Mac memory
24 GB+

gemma · updated 2025-06-29

LongCat-Flash-Lite-4bit

from meituan-longcat/LongCat-Flash-Lite
4-bit
Text generation · meituan-longcat ↓ 91 · ♥ 4
Params
69B
Weights
≈ 38.6 GB
Mac memory
48 GB+

mit · updated 2026-01-29

Qwen3-30B-A3B-bf16

from Qwen/Qwen3-30B-A3B
bf16
Text generation · Qwen ↓ 91 · ♥ 2
Params
31B
Weights
≈ 61.1 GB
Mac memory
96 GB+

apache-2.0 · updated 2025-04-28

c4ai-command-r-08-2024-4bit

mlx-community/c4ai-command-r-08-2024-4bit
4-bit
Text generation ↓ 91 · ♥ 2
Params
32B
Weights
≈ 18.2 GB
Mac memory
24 GB+

cc-by-nc-4.0 · updated 2024-08-31

Josiefied-Qwen3-14B-abliterated-v3-bf16

from Goekdeniz-Guelmez/Josiefied-Qwen3-14B-abliterated-v3
bf16
Text generation · Goekdeniz-Guelmez ↓ 91 · ♥ 1
Params
15B
Weights
≈ 59.1 GB
Mac memory
96 GB+

updated 2025-06-04

LFM2.5-1.2B-Instruct-8bit

from LiquidAI/LFM2.5-1.2B-Instruct
8-bit
Text generation · LiquidAI ↓ 91 · ♥ 1
Params
1.2B
Weights
≈ 1.2 GB
Mac memory
8 GB+

lfm1.0 · updated 2026-08-13

CodeLlama-7b-Python-hf-4bit-mlx

mlx-community/CodeLlama-7b-Python-hf-4bit-mlx
4-bit
Text generation ↓ 91 · ♥ 0
Params
—
Weights
—
Mac memory
—

llama2 · updated 2024-01-04

ERNIE-4.5-0.3B-PT-bf16-ft

from baidu/ERNIE-4.5-0.3B-PT
bf16
Text generation · baidu ↓ 91 · ♥ 0
Params
361M
Weights
≈ 721 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-07-13

Meta-Llama-3.1-70B-bf16

mlx-community/Meta-Llama-3.1-70B-bf16
bf16
Text generation ↓ 90 · ♥ 4
Params
71B
Weights
≈ 141 GB
Mac memory
192 GB+

llama3.1 · updated 2024-07-23

DeepSeek-V4-Flash-mxfp8

mlx-community/DeepSeek-V4-Flash-mxfp8
MXFP8
Text generation ↓ 90 · ♥ 2
Params
284B
Weights
≈ 302 GB
Mac memory
512 GB+

updated 2026-04-25

Phi-3-mini-4k-instruct-8bit

mlx-community/Phi-3-mini-4k-instruct-8bit
8-bit
Text generation ↓ 90 · ♥ 2
Params
3.8B
Weights
≈ 4.1 GB
Mac memory
8 GB+

mit · updated 2024-07-04

Baichuan-M1-14B-Instruct-4bit

from baichuan-inc/Baichuan-M1-14B-Instruct
4-bit
Text generation · baichuan-inc ↓ 90 · ♥ 1
Params
14B
Weights
≈ 8.1 GB
Mac memory
16 GB+

updated 2025-04-25

CodeLlama-7b-Python-hf-8bit-mlx

mlx-community/CodeLlama-7b-Python-hf-8bit-mlx
8-bit
Text generation ↓ 90 · ♥ 1
Params
—
Weights
—
Mac memory
—

llama2 · updated 2024-01-04

NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-5Bit

from nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
5-bit
Text generation · NVIDIA ↓ 90 · ♥ 0
Params
5.9B
Weights
≈ 5.4 GB
Mac memory
16 GB+

nvidia-open-model-license · updated 2025-12-17

Qwen3-4B-Instruct-2507-4bit-g32

from Qwen/Qwen3-4B-Instruct-2507
4-bit
Text generation · Qwen ↓ 90 · ♥ 0
Params
4.0B
Weights
≈ 2.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-11

gemma-3-1b-it-abliterated-4bit

from mlabonne/gemma-3-1b-it-abliterated
4-bit
Text generation · mlabonne ↓ 90 · ♥ 0
Params
1.3B
Weights
≈ 732 MB
Mac memory
8 GB+

gemma · updated 2025-03-22