Skip to content
Apple silicon

Apple MLX models

5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 1h ago. Weights size and Mac memory are estimates from parameter count and quantisation.

Alert me about new Apple/MLX models

2,922 builds · page 29 of 49 · clear filters

qwen2.5-0.5b-instruct-q2

from Qwen/Qwen2.5-0.5B-Instruct
2-bit
Text generation · Qwen ↓ 46 · ♥ 0
Params
494M
Weights
≈ 155 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-01-09

GLM-4.6-bf16

from zai-org/GLM-4.6
bf16
Text generation · zai-org ↓ 45 · ♥ 3
Params
353B
Weights
≈ 706 GB
Mac memory
> 512 GB

mit · updated 2025-10-07

Llama-3-70B-Instruct-Gradient-262k-4bit

mlx-community/Llama-3-70B-Instruct-Gradient-262k-4bit
4-bit
Text generation ↓ 45 · ♥ 3
Params
71B
Weights
≈ 39.7 GB
Mac memory
48 GB+

llama3 · updated 2024-05-04

MiniMax-M2.1-6bit

from MiniMaxAI/MiniMax-M2.1
6-bit
Text generation · MiniMaxAI ↓ 45 · ♥ 2
Params
229B
Weights
≈ 186 GB
Mac memory
256 GB+

modified-mit · updated 2026-01-06

SmolLM-360M-Instruct-8bit

mlx-community/SmolLM-360M-Instruct-8bit
8-bit
Text generation ↓ 45 · ♥ 2
Params
362M
Weights
≈ 384 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-07-16

granite-3.3-8b-instruct-8bit

from ibm-granite/granite-3.3-8b-instruct
8-bit
Text generation · IBM · Granite ↓ 45 · ♥ 2
Params
8.2B
Weights
≈ 8.7 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-04-16

Mellum2-12B-A2.5B-Thinking-mxfp4

from JetBrains/Mellum2-12B-A2.5B-Thinking
MXFP4
Text generation · JetBrains ↓ 45 · ♥ 1
Params
12B
Weights
≈ 6.8 GB
Mac memory
16 GB+

apache-2.0 · updated 2026-08-11

OpenR1-Qwen-7B-4bit

from open-r1/OpenR1-Qwen-7B
4-bit
Text generation · open-r1 ↓ 45 · ♥ 1
Params
7.6B
Weights
≈ 4.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-02-21

YanoljaNEXT-Rosetta-12B-2510-mlx-bf16

from yanolja/YanoljaNEXT-Rosetta-12B-2510
bf16
Text generation · yanolja ↓ 45 · ♥ 1
Params
13B
Weights
≈ 25.5 GB
Mac memory
32 GB+

gemma · updated 2025-12-04

granite-3.2-8b-instruct-preview-4bit

from ibm-granite/granite-3.2-8b-instruct-preview
4-bit
Text generation · IBM · Granite ↓ 45 · ♥ 1
Params
8.2B
Weights
≈ 4.6 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-02-08

llm-jp-3-8x13b-instruct3-4bit

from llm-jp/llm-jp-3-8x13b-instruct3
4-bit
Text generation · llm-jp ↓ 45 · ♥ 1
Params
73B
Weights
≈ 41.2 GB
Mac memory
48 GB+

apache-2.0 · updated 2025-03-27

ELYZA-Thinking-1.0-Qwen-32B-4bit

from elyza/ELYZA-Thinking-1.0-Qwen-32B
4-bit
Text generation · elyza ↓ 45 · ♥ 0
Params
33B
Weights
≈ 18.4 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-05-01

Hunyuan-7B-Instruct-2508-4bit

from tencent/Hunyuan-7B-Instruct
4-bit
Text generation · tencent ↓ 45 · ♥ 0
Params
7.5B
Weights
≈ 4.2 GB
Mac memory
8 GB+

updated 2025-08-04

Josiefied-Qwen3-0.6B-abliterated-v2-4bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v2
4-bit
Text generation · Goekdeniz-Guelmez ↓ 45 · ♥ 0
Params
596M
Weights
≈ 335 MB
Mac memory
8 GB+

updated 2026-01-11

Llama-3.1-Swallow-8B-Instruct-v0.3-8bit

from tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.3
8-bit
Text generation · tokyotech-llm ↓ 45 · ♥ 0
Params
8.0B
Weights
≈ 8.5 GB
Mac memory
16 GB+

llama3.1 · updated 2024-12-23

Llama-3.1-Tulu-3-8B-4bit

from allenai/Llama-3.1-Tulu-3-8B
4-bit
Text generation · Ai2 · OLMo ↓ 45 · ♥ 0
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

llama3.1 · updated 2024-11-25

Olmo-3-1025-7B-bfloat16

from allenai/Olmo-3-1025-7B
Text generation · Ai2 · OLMo ↓ 45 · ♥ 0
Params
7.3B
Weights
≈ 14.6 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-11-20

Phi-3-medium-4k-instruct-4bit

mlx-community/Phi-3-medium-4k-instruct-4bit
4-bit
Text generation ↓ 45 · ♥ 0
Params
14B
Weights
≈ 7.9 GB
Mac memory
16 GB+

mit · updated 2024-07-11

Qwen2-57B-A14B-4bit

mlx-community/Qwen2-57B-A14B-4bit
4-bit
Text generation ↓ 45 · ♥ 0
Params
57B
Weights
≈ 32.3 GB
Mac memory
48 GB+

apache-2.0 · updated 2024-06-06

Qwen3-235B-A22B-Instruct-2507-6bit

from Qwen/Qwen3-235B-A22B-Instruct-2507
6-bit
Text generation · Qwen ↓ 45 · ♥ 0
Params
235B
Weights
≈ 191 GB
Mac memory
256 GB+

apache-2.0 · updated 2025-07-22

SmolLM-135M-8bit

mlx-community/SmolLM-135M-8bit
8-bit
Text generation ↓ 45 · ♥ 0
Params
135M
Weights
≈ 143 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-07-16

gemma-4-12B-it-qat-assistant-mxfp8

from google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
MXFP8
Text generation · Google · Gemma ↓ 45 · ♥ 0
Params
423M
Weights
≈ 449 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

openchat-3.5-0106

from mistralai/Mistral-7B-v0.1
Text generation · Mistral ↓ 45 · ♥ 0
Params
—
Weights
—
Mac memory
—

apache-2.0 · updated 2024-02-11

smallthinker-3b-preview-q4

from Tiiny/SmallThinker-3B-Preview
4-bit
Text generation · Tiiny ↓ 45 · ♥ 0
Params
3.1B
Weights
≈ 1.7 GB
Mac memory
8 GB+

updated 2025-01-05

DeepScaleR-1.5B-6.5bit

from agentica-org/DeepScaleR-1.5B-Preview
5-bit
Text generation · agentica-org ↓ 44 · ♥ 4
Params
1.8B
Weights
≈ 1.2 GB
Mac memory
8 GB+

mit · updated 2025-02-17

Nemotron-Cascade-2-30B-A3B-mlx-6bit

from nvidia/Nemotron-Cascade-2-30B-A3B
6-bit
Text generation · NVIDIA ↓ 44 · ♥ 3
Params
32B
Weights
≈ 25.7 GB
Mac memory
32 GB+

nvidia-open-model-license · updated 2026-03-20

Qwen1.5-32B-Chat-4bit

mlx-community/Qwen1.5-32B-Chat-4bit
4-bit
Text generation ↓ 44 · ♥ 3
Params
33B
Weights
≈ 19.4 GB
Mac memory
24 GB+

tongyi-qianwen · updated 2024-04-05

gemma-2-2b-jpn-it

from google/gemma-2-2b-it
Text generation · Google · Gemma ↓ 44 · ♥ 3
Params
2.6B
Weights
≈ 5.2 GB
Mac memory
8 GB+

gemma · updated 2024-10-03

CodeLlama-7b-Instruct-hf-4bit-mlx-2

from codellama/CodeLlama-7b-Instruct-hf
4-bit
Text generation · codellama ↓ 44 · ♥ 1
Params
6.7B
Weights
≈ 3.8 GB
Mac memory
8 GB+

llama2 · updated 2025-04-28

DeepHermes-3-Mistral-24B-Preview-4bit

from NousResearch/DeepHermes-3-Mistral-24B-Preview
4-bit
Text generation · NousResearch ↓ 44 · ♥ 1
Params
24B
Weights
≈ 13.3 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-03-14

Qwen2.5-14B-1M-YOYO-V2-Q4

from YOYO-AI/Qwen2.5-14B-YOYO-latest-V2
4-bit
Text generation · YOYO-AI ↓ 44 · ♥ 1
Params
15B
Weights
≈ 8.3 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-02-18

aya-23-8B-8bit

mlx-community/aya-23-8B-8bit
8-bit
Text generation ↓ 44 · ♥ 1
Params
8.0B
Weights
≈ 8.5 GB
Mac memory
16 GB+

cc-by-nc-4.0 · updated 2024-05-23

granite-4.1-8b-nvfp4

from ibm-granite/granite-4.1-8b
4-bit
Text generation · IBM · Granite ↓ 44 · ♥ 1
Params
8.4B
Weights
≈ 4.7 GB
Mac memory
8 GB+

apache-2.0 · updated 2026-05-03

stable-code-3b-4bit

mlx-community/stable-code-3b-4bit
4-bit
Text generation ↓ 44 · ♥ 1
Params
2.8B
Weights
≈ 1.8 GB
Mac memory
8 GB+

other · updated 2024-03-18

swahili-gemma-1b-mlx-fp16

from CraneAILabs/swahili-gemma-1b
fp16
Text generation · CraneAILabs ↓ 44 · ♥ 1
Params
1.3B
Weights
≈ 2.6 GB
Mac memory
8 GB+

gemma · updated 2025-08-26

AREX-Base-mixed-mxfp4-bf16

from BAAI/AREX-Base
MXFP4
Text generation · BAAI ↓ 44 · ♥ 0
Params
123B
Weights
≈ 78.4 GB
Mac memory
96 GB+

apache-2.0 · updated 2026-07-29

AceReason-Nemotron-1.1-7B-bf16

from nvidia/AceReason-Nemotron-1.1-7B
bf16
Text generation · NVIDIA ↓ 44 · ♥ 0
Params
7.6B
Weights
≈ 15.2 GB
Mac memory
24 GB+

nvidia-open-model-license · updated 2025-06-17

EuroLLM-22B-Instruct-2512-mlx-5bit

from utter-project/EuroLLM-22B-Instruct-2512
5-bit
Text generation · utter-project ↓ 44 · ♥ 0
Params
23B
Weights
≈ 15.6 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-12-16

Gemma-2-9B-It-SPPO-Iter3-mixed-4-6-bit

from UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
6-bit
Text generation · UCLA-AGI ↓ 44 · ♥ 0
Params
9.2B
Weights
≈ 7.5 GB
Mac memory
16 GB+

gemma · updated 2025-07-22

Gemma-SEA-LION-v4.5-E2B-IT-8bits

from aisingapore/Gemma-SEA-LION-v4.5-E2B-IT
8-bit
Text generation · aisingapore ↓ 44 · ♥ 0
Params
4.6B
Weights
≈ 4.9 GB
Mac memory
8 GB+

mit · updated 2026-06-21

Josiefied-Qwen3-1.7B-abliterated-v1-8bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-1.7B-abliterated-v1
8-bit
Text generation · Goekdeniz-Guelmez ↓ 44 · ♥ 0
Params
1.7B
Weights
≈ 1.8 GB
Mac memory
8 GB+

updated 2025-05-01

Laguna-M.1-mxfp4

from poolside/Laguna-M.1
MXFP4
Text generation · poolside ↓ 44 · ♥ 0
Params
226B
Weights
≈ 127 GB
Mac memory
192 GB+

apache-2.0 · updated 2026-06-18

Mellum2-12B-A2.5B-Thinking-bf16

from JetBrains/Mellum2-12B-A2.5B-Thinking
bf16
Text generation · JetBrains ↓ 44 · ♥ 0
Params
12B
Weights
≈ 24.3 GB
Mac memory
32 GB+

apache-2.0 · updated 2026-08-11

Qwen3-0.6B-Base

from Qwen/Qwen3-0.6B-Base
Text generation · Qwen ↓ 44 · ♥ 0
Params
596M
Weights
≈ 1.2 GB
Mac memory
8 GB+

apache-2.0 · updated 2026-02-27

Qwen3-4B-Sky-High-Hermes-gabliterated-bfloat16

from Goekdeniz-Guelmez/Qwen3-4B-Sky-High-Hermes-gabliterated
Text generation · Goekdeniz-Guelmez ↓ 44 · ♥ 0
Params
4.0B
Weights
≈ 8.0 GB
Mac memory
16 GB+

updated 2026-01-23

Qwen3-VL-Text-30B-A3B-Instruct-bf16

mlx-community/Qwen3-VL-Text-30B-A3B-Instruct-bf16
bf16
Text generation ↓ 44 · ♥ 0
Params
31B
Weights
≈ 61.1 GB
Mac memory
96 GB+

updated 2025-12-25

c4ai-command-r-plus-2bit

mlx-community/c4ai-command-r-plus-2bit
2-bit
Text generation ↓ 44 · ♥ 0
Params
104B
Weights
≈ 37.8 GB
Mac memory
48 GB+

cc-by-nc-4.0 · updated 2024-04-15

command-a-reasoning-08-2025-8bit

from CohereLabs/command-a-reasoning-08-2025
8-bit
Text generation · Cohere ↓ 44 · ♥ 0
Params
111B
Weights
≈ 118 GB
Mac memory
192 GB+

cc-by-nc-4.0 · updated 2025-08-26

gemma-3-1b-it-DQ

from google/gemma-3-1b-it
4-bit
Text generation · Google · Gemma ↓ 44 · ♥ 0
Params
1.3B
Weights
≈ 732 MB
Mac memory
8 GB+

gemma · updated 2025-06-15

gemma-4-31B-it-qat-assistant-6bit

from google/gemma-4-31B-it-qat-q4_0-unquantized-assistant
6-bit
Text generation · Google · Gemma ↓ 44 · ♥ 0
Params
470M
Weights
≈ 382 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

llama3-8b-cpt-sahabatai-v1-instruct-4bit

from GoToCompany/llama3-8b-cpt-sahabatai-v1-instruct
4-bit
Text generation · GoToCompany ↓ 44 · ♥ 0
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

llama3 · updated 2026-06-06

llm-jp-3-172b-beta1-instruct-4bit

mlx-community/llm-jp-3-172b-beta1-instruct-4bit
4-bit
Text generation ↓ 44 · ♥ 0
Params
172B
Weights
≈ 97.0 GB
Mac memory
128 GB+

llm-jp-3-172b-beta1-tou · updated 2024-09-18

llm-jp-3.1-8x13b-instruct4-8bit

from llm-jp/llm-jp-3.1-8x13b-instruct4
8-bit
Text generation · llm-jp ↓ 44 · ♥ 0
Params
73B
Weights
≈ 77.7 GB
Mac memory
96 GB+

apache-2.0 · updated 2025-06-16

prometheus-7b-v2.0-8bit

mlx-community/prometheus-7b-v2.0-8bit
8-bit
Text generation ↓ 44 · ♥ 0
Params
7.2B
Weights
≈ 7.7 GB
Mac memory
16 GB+

apache-2.0 · updated 2024-09-04

simplescaling-s1-32B-fp32

from simplescaling/s1-32B
fp32
Text generation · simplescaling ↓ 44 · ♥ 0
Params
33B
Weights
≈ 131 GB
Mac memory
192 GB+

apache-2.0 · updated 2025-02-16