Skip to content
Apple silicon

Apple MLX models

5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 2h ago. Weights size and Mac memory are estimates from parameter count and quantisation.

Alert me about new Apple/MLX models

2,922 builds · page 32 of 49 · clear filters

Jan-v3-4B-base-instruct-6bit

from janhq/Jan-v3-4B-base-instruct
6-bit
Text generation · janhq ↓ 40 · ♥ 1
Params
4.0B
Weights
≈ 3.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2026-01-28

Ling-2.6-flash-mlx-8bit

from inclusionAI/Ling-2.6-flash
8-bit
Text generation · inclusionAI ↓ 40 · ♥ 1
Params
104B
Weights
≈ 111 GB
Mac memory
128 GB+

mit · updated 2026-04-29

Llama-3-8B-Instruct-262k-2bit

mlx-community/Llama-3-8B-Instruct-262k-2bit
2-bit
Text generation ↓ 40 · ♥ 1
Params
8.0B
Weights
≈ 2.5 GB
Mac memory
8 GB+

llama3 · updated 2024-05-05

Magicoder-S-DS-6.7B-MLX

mlx-community/Magicoder-S-DS-6.7B-MLX
Text generation ↓ 40 · ♥ 1
Params
6.7B
Weights
≈ 13.5 GB
Mac memory
24 GB+

deepseek · updated 2024-03-02

Phi-4-reasoning-8bit

from microsoft/Phi-4-reasoning
8-bit
Text generation · Microsoft · Phi ↓ 40 · ♥ 1
Params
15B
Weights
≈ 15.6 GB
Mac memory
24 GB+

mit · updated 2025-05-01

Qwen2-1.5B-Instruct-8bit

mlx-community/Qwen2-1.5B-Instruct-8bit
8-bit
Text generation ↓ 40 · ♥ 1
Params
1.5B
Weights
≈ 1.6 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-06-06

Qwen3-18B-A3B-Stranger-Thoughts-Q_8

from DavidAU/Qwen3-18B-A3B-Stranger-Thoughts
8-bit
Text generation · DavidAU ↓ 40 · ♥ 1
Params
17B
Weights
≈ 18.4 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-06-28

granite-4.0-h-tiny-6bit-MLX

from ibm-granite/granite-4.0-h-tiny
6-bit
Text generation · IBM · Granite ↓ 40 · ♥ 1
Params
6.9B
Weights
≈ 5.6 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-10-03

helium-1-preview-2b-8bit

from kyutai/helium-1-preview-2b
8-bit
Text generation · kyutai ↓ 40 · ♥ 1
Params
2.2B
Weights
≈ 2.3 GB
Mac memory
8 GB+

cc-by-4.0 · updated 2025-01-18

simplescaling-s1-32B-4bit

from simplescaling/s1-32B
4-bit
Text generation · simplescaling ↓ 40 · ♥ 1
Params
33B
Weights
≈ 18.4 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-02-11

Apriel-1.5-15b-Thinker-8bit

mlx-community/Apriel-1.5-15b-Thinker-8bit
8-bit
Text generation ↓ 40 · ♥ 0
Params
—
Weights
—
Mac memory
—

mit · updated 2025-10-03

CodeLlama-13b-hf-4bit-mlx

from codellama/CodeLlama-13b-hf
4-bit
Text generation · codellama ↓ 40 · ♥ 0
Params
13B
Weights
≈ 7.3 GB
Mac memory
16 GB+

llama2 · updated 2025-04-27

DeepCoder-1.5B-Preview-8bit

from agentica-org/DeepCoder-1.5B-Preview
8-bit
Text generation · agentica-org ↓ 40 · ♥ 0
Params
1.8B
Weights
≈ 1.9 GB
Mac memory
8 GB+

mit · updated 2025-04-21

DeepSeek-R1-0528-8bit

mlx-community/DeepSeek-R1-0528-8bit
8-bit
Text generation ↓ 40 · ♥ 0
Params
671B
Weights
≈ 713 GB
Mac memory
> 512 GB

updated 2025-08-03

ERNIE-4.5-21B-A3B-PT-6bit

from baidu/ERNIE-4.5-21B-A3B-PT
6-bit
Text generation · baidu ↓ 40 · ♥ 0
Params
22B
Weights
≈ 17.7 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-07-04

Falcon-H1-Tiny-Coder-90M-5bit

from tiiuae/Falcon-H1-Tiny-Coder-90M
5-bit
Text generation · TII · Falcon ↓ 40 · ♥ 0
Params
91M
Weights
≈ 63 MB
Mac memory
8 GB+

falcon-llm-license · updated 2026-01-28

Falcon-H1-Tiny-Coder-90M-6bit

from tiiuae/Falcon-H1-Tiny-Coder-90M
6-bit
Text generation · TII · Falcon ↓ 40 · ♥ 0
Params
91M
Weights
≈ 74 MB
Mac memory
8 GB+

falcon-llm-license · updated 2026-01-28

Falcon3-10B-Instruct-1.58bit-6bit

from tiiuae/Falcon3-10B-Instruct-1.58bit
58-bit
Text generation · TII · Falcon ↓ 40 · ♥ 0
Params
2.6B
Weights
≈ 3.0 GB
Mac memory
8 GB+

falcon-llm-license · updated 2025-06-10

Jan-v1-4B-5bit

from janhq/Jan-v1-4B
5-bit
Text generation · janhq ↓ 40 · ♥ 0
Params
4.0B
Weights
≈ 2.8 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-08-12

Josiefied-Qwen3-4B-abliterated-v1-8bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v1
8-bit
Text generation · Goekdeniz-Guelmez ↓ 40 · ♥ 0
Params
4.0B
Weights
≈ 4.3 GB
Mac memory
8 GB+

updated 2025-05-01

LFM2.5-1.2B-Thinking-bf16

from LiquidAI/LFM2.5-1.2B-Thinking
bf16
Text generation · LiquidAI ↓ 40 · ♥ 0
Params
1.2B
Weights
≈ 2.3 GB
Mac memory
8 GB+

lfm1.0 · updated 2026-08-13

Laguna-XS.2-6bit

from poolside/Laguna-XS.2
6-bit
Text generation · poolside ↓ 40 · ♥ 0
Params
33B
Weights
≈ 27.2 GB
Mac memory
48 GB+

apache-2.0 · updated 2026-04-28

Mellum-4b-sft-kotlin-4bit

from JetBrains/Mellum-4b-sft-kotlin
4-bit
Text generation · JetBrains ↓ 40 · ♥ 0
Params
4.0B
Weights
≈ 2.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-06-28

Qwen1.5-0.5B-4bit

mlx-community/Qwen1.5-0.5B-4bit
4-bit
Text generation ↓ 40 · ♥ 0
Params
620M
Weights
≈ 572 MB
Mac memory
8 GB+

tongyi-qianwen-research · updated 2024-04-08

Qwen2-57B-A14B-8bit

mlx-community/Qwen2-57B-A14B-8bit
8-bit
Text generation ↓ 40 · ♥ 0
Params
57B
Weights
≈ 61.0 GB
Mac memory
96 GB+

apache-2.0 · updated 2024-06-06

Qwen2-Math-72B-Instruct-4bit

mlx-community/Qwen2-Math-72B-Instruct-4bit
4-bit
Text generation ↓ 40 · ♥ 0
Params
73B
Weights
≈ 40.9 GB
Mac memory
48 GB+

tongyi-qianwen · updated 2024-08-10

Qwen3-0.6B-gabliterated-mxfp4

from Goekdeniz-Guelmez/Qwen3-0.6B-gabliterated
MXFP4
Text generation · Goekdeniz-Guelmez ↓ 40 · ♥ 0
Params
596M
Weights
≈ 1.2 GB
Mac memory
8 GB+

updated 2026-01-06

falcon-mamba-7b-4bit-instruct

from tiiuae/falcon-mamba-7b-instruct
4-bit
Text generation · TII · Falcon ↓ 40 · ♥ 0
Params
7.3B
Weights
≈ 4.1 GB
Mac memory
8 GB+

falcon-mamba-7b-license · updated 2024-11-15

gemma-3-270m-qat-4bit

from google/gemma-3-270m-qat
4-bit
Text generation · Google · Gemma ↓ 40 · ♥ 0
Params
436M
Weights
≈ 245 MB
Mac memory
8 GB+

gemma · updated 2025-08-09

gemma-3-text-27b-pt-4bit

from mlx-community/gemma-3-27b-pt-bf16
4-bit
Text generation ↓ 40 · ♥ 0
Params
28B
Weights
≈ 16.0 GB
Mac memory
24 GB+

gemma · updated 2025-03-18

gemma-4-E4B-it-qat-assistant-nvfp4

from google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant
4-bit
Text generation · Google · Gemma ↓ 40 · ♥ 0
Params
79M
Weights
≈ 45 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

granite-20b-code-instruct-8bit

from ibm-granite/granite-20b-code-base-8k
8-bit
Text generation · IBM · Granite ↓ 40 · ♥ 0
Params
20B
Weights
≈ 21.3 GB
Mac memory
32 GB+

apache-2.0 · updated 2024-05-14

granite-4.1-8b-6bit

from ibm-granite/granite-4.1-8b
6-bit
Text generation · IBM · Granite ↓ 40 · ♥ 0
Params
8.4B
Weights
≈ 6.8 GB
Mac memory
16 GB+

apache-2.0 · updated 2026-05-03

h2o-danube3-500m-chat

from h2oai/h2o-danube3-500m-chat
4-bit
Text generation · h2oai ↓ 40 · ♥ 0
Params
514M
Weights
≈ 289 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-01-24

llama2-13b-qnt4bit

mlx-community/llama2-13b-qnt4bit
Text generation ↓ 40 · ♥ 0
Params
6.7B
Weights
≈ 26.7 GB
Mac memory
32 GB+

updated 2024-03-21

llama2-70-test-4bit

mlx-community/llama2-70-test-4bit
4-bit
Text generation ↓ 40 · ♥ 0
Params
—
Weights
—
Mac memory
—

updated 2024-03-18

llm-jp-3-13b-instruct-8bit

mlx-community/llm-jp-3-13b-instruct-8bit
8-bit
Text generation ↓ 40 · ♥ 0
Params
14B
Weights
≈ 14.6 GB
Mac memory
24 GB+

apache-2.0 · updated 2024-09-25

llm-jp-3.1-8x13b-instruct4-4bit

from llm-jp/llm-jp-3.1-8x13b-instruct4
4-bit
Text generation · llm-jp ↓ 40 · ♥ 0
Params
73B
Weights
≈ 41.2 GB
Mac memory
48 GB+

apache-2.0 · updated 2025-06-16

math-phi-v1

mlx-community/math-phi-v1
Text generation ↓ 40 · ♥ 0
Params
2.8B
Weights
≈ 10.9 GB
Mac memory
16 GB+

mit · updated 2024-02-29

granite-4.1-30b-mxfp4

from ibm-granite/granite-4.1-30b
MXFP4
Text generation · IBM · Granite ↓ 39 · ♥ 2
Params
29B
Weights
≈ 16.2 GB
Mac memory
24 GB+

apache-2.0 · updated 2026-04-30

DeepCoder-14B-Preview-6bit

from agentica-org/DeepCoder-14B-Preview
6-bit
Text generation · agentica-org ↓ 39 · ♥ 1
Params
15B
Weights
≈ 12.0 GB
Mac memory
16 GB+

mit · updated 2025-04-08

LFM2-2.6B-Exp-6bit

from LiquidAI/LFM2-2.6B-Exp
6-bit
Text generation · LiquidAI ↓ 39 · ♥ 1
Params
2.6B
Weights
≈ 2.1 GB
Mac memory
8 GB+

lfm1.0 · updated 2025-12-26

Llama-3-70B-Instruct-Gradient-262k-2bit

mlx-community/Llama-3-70B-Instruct-Gradient-262k-2bit
2-bit
Text generation ↓ 39 · ♥ 1
Params
71B
Weights
≈ 22.1 GB
Mac memory
32 GB+

llama3 · updated 2024-05-03

Llama-3.1-Swallow-8B-Instruct-v0.1-8bit

from tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.1
8-bit
Text generation · tokyotech-llm ↓ 39 · ♥ 1
Params
8.0B
Weights
≈ 8.5 GB
Mac memory
16 GB+

llama3.1 · updated 2024-10-08

Llama3-Med42-8B

from m42-health/Llama3-Med42-8B
4-bit
Text generation · m42-health ↓ 39 · ♥ 1
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

llama3 · updated 2025-01-15

Nemotron-Cascade-2-30B-A3B-mxfp4

from nvidia/Nemotron-Cascade-2-30B-A3B
MXFP4
Text generation · NVIDIA ↓ 39 · ♥ 1
Params
32B
Weights
≈ 17.8 GB
Mac memory
24 GB+

nvidia-open-model-license · updated 2026-04-30

RakutenAI-2.0-mini-MLX-4bit

from Rakuten/RakutenAI-2.0-mini
4-bit
Text generation · Rakuten ↓ 39 · ♥ 1
Params
1.5B
Weights
≈ 863 MB
Mac memory
8 GB+

apache-2.0 · updated 2026-03-20

Step-3.7-Flash-8bit

from stepfun-ai/Step-3.7-Flash
8-bit
Text generation · stepfun-ai ↓ 39 · ♥ 1
Params
197B
Weights
≈ 209 GB
Mac memory
256 GB+

apache-2.0 · updated 2026-05-29

c4ai-command-a-03-2025-8bit

from CohereLabs/c4ai-command-a-03-2025
8-bit
Text generation · Cohere ↓ 39 · ♥ 1
Params
111B
Weights
≈ 118 GB
Mac memory
192 GB+

cc-by-nc-4.0 · updated 2025-03-18

grug-27b-Text-mlx-8Bit

from ProCreations/grug-27b
8-bit
Text generation · ProCreations ↓ 39 · ♥ 1
Params
27B
Weights
≈ 28.6 GB
Mac memory
48 GB+

apache-2.0 · updated 2026-07-23

internlm2_5-20b-chat_8bit

mlx-community/internlm2_5-20b-chat_8bit
8-bit
Text generation ↓ 39 · ♥ 1
Params
20B
Weights
≈ 21.1 GB
Mac memory
32 GB+

other · updated 2024-08-22

Cydonia-24B-v3-bf16

from TheDrummer/Cydonia-24B-v3
bf16
Text generation · TheDrummer ↓ 39 · ♥ 0
Params
24B
Weights
≈ 47.1 GB
Mac memory
64 GB+

other · updated 2025-06-04

Falcon-H1-Tiny-90M-Base-4bit

from tiiuae/Falcon-H1-Tiny-90M-Base
4-bit
Text generation · TII · Falcon ↓ 39 · ♥ 0
Params
91M
Weights
≈ 51 MB
Mac memory
8 GB+

falcon-llm-license · updated 2026-01-28

Falcon-H1-Tiny-R-0.6B-4bit

from tiiuae/Falcon-H1-Tiny-R-0.6B
4-bit
Text generation · TII · Falcon ↓ 39 · ♥ 0
Params
622M
Weights
≈ 351 MB
Mac memory
8 GB+

falcon-llm-license · updated 2026-01-28

Falcon3-7B-Instruct-1.58bit

from tiiuae/Falcon3-7B-Instruct-1.58bit
58-bit
Text generation · TII · Falcon ↓ 39 · ♥ 0
Params
2.5B
Weights
≈ 3.3 GB
Mac memory
8 GB+

falcon-llm-license · updated 2025-06-10

INTELLECT-1-Instruct-8bit

from PrimeIntellect/INTELLECT-1-Instruct
8-bit
Text generation · PrimeIntellect ↓ 39 · ♥ 0
Params
10B
Weights
≈ 10.8 GB
Mac memory
16 GB+

apache-2.0 · updated 2024-11-30

IQuest-Coder-V1-14B-Instruct-8bit

mlx-community/IQuest-Coder-V1-14B-Instruct-8bit
8-bit
Text generation ↓ 39 · ♥ 0
Params
14B
Weights
≈ 15.3 GB
Mac memory
24 GB+

updated 2026-03-31

Llama-3_3-Nemotron-Super-49B-v1-mlx-6bit

from nvidia/Llama-3_3-Nemotron-Super-49B-v1
6-bit
Text generation · NVIDIA ↓ 39 · ♥ 0
Params
50B
Weights
≈ 40.5 GB
Mac memory
48 GB+

nvidia-open-model-license · updated 2025-04-08

My-Phi-3-medium-128k-instruct-4bit

mlx-community/My-Phi-3-medium-128k-instruct-4bit
4-bit
Text generation ↓ 39 · ♥ 0
Params
14B
Weights
≈ 7.9 GB
Mac memory
16 GB+

mit · updated 2024-07-08

Ouro-1.4B-4bit

from ByteDance/Ouro-1.4B
4-bit
Text generation · ByteDance ↓ 39 · ♥ 0
Params
1.4B
Weights
≈ 807 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-11-09