Skip to content
Apple silicon

Apple MLX models

5,842 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 1h ago. Weights size and Mac memory are estimates from parameter count and quantisation.

Alert me about new Apple/MLX models

5,842 builds · page 67 of 98

Falcon3-10B-Instruct-abliterated-6bit

from huihui-ai/Falcon3-10B-Instruct-abliterated
6-bit
Text generation · huihui-ai ↓ 34 · ♥ 0
Params
10B
Weights
≈ 8.4 GB
Mac memory
16 GB+

falcon-llm-license · updated 2025-02-19

Holo1-7B-6bit

from Qwen/Qwen2.5-VL-7B-Instruct
6-bit
Vision + text · Qwen ↓ 34 · ♥ 0
Params
—
Weights
—
Mac memory
—

apache-2.0 · updated 2025-06-03

Huihui-gemma-3-270m-it-abliterated-fp16

from huihui-ai/Huihui-gemma-3-270m-it-abliterated
fp16
Text generation · huihui-ai ↓ 34 · ♥ 0
Params
268M
Weights
≈ 536 MB
Mac memory
8 GB+

gemma · updated 2025-09-27

InternVL3-78B-4bit

from OpenGVLab/InternVL3-1B-Instruct
4-bit
Vision + text · OpenGVLab ↓ 34 · ♥ 0
Params
—
Weights
—
Mac memory
—

apache-2.0 · updated 2025-04-30

Josiefied-Qwen3-0.6B-abliterated-v1-bf16

from Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v1
bf16
Text generation · Goekdeniz-Guelmez ↓ 34 · ♥ 0
Params
596M
Weights
≈ 1.2 GB
Mac memory
8 GB+

updated 2025-04-29

Josiefied-Qwen3-0.6B-abliterated-v2-8bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v2
8-bit
Text generation · Goekdeniz-Guelmez ↓ 34 · ♥ 0
Params
596M
Weights
≈ 633 MB
Mac memory
8 GB+

updated 2026-01-11

LFM2-VL-3B-6bit

mlx-community/LFM2-VL-3B-6bit
6-bit
Vision + text ↓ 34 · ♥ 0
Params
3.0B
Weights
≈ 2.9 GB
Mac memory
8 GB+

lfm1.0 · updated 2026-01-15

Llama-3-8B-Instruct-Gradient-1048k-2bit

mlx-community/Llama-3-8B-Instruct-Gradient-1048k-2bit
2-bit
Text generation ↓ 34 · ♥ 0
Params
8.0B
Weights
≈ 2.5 GB
Mac memory
8 GB+

llama3 · updated 2024-05-05

Llama-3-Swallow-70B-Instruct-v0.1-4bit

mlx-community/Llama-3-Swallow-70B-Instruct-v0.1-4bit
4-bit
Text generation ↓ 34 · ♥ 0
Params
71B
Weights
≈ 39.7 GB
Mac memory
48 GB+

llama3 · updated 2024-07-01

Llama-3.1-Swallow-70B-Instruct-v0.1-8bit

from tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.1
8-bit
Text generation · tokyotech-llm ↓ 34 · ♥ 0
Params
71B
Weights
≈ 75.0 GB
Mac memory
96 GB+

llama3.1 · updated 2024-10-08

MediPhi-Instruct-bf16

from microsoft/MediPhi-Instruct
bf16
Text generation · Microsoft · Phi ↓ 34 · ♥ 0
Params
3.8B
Weights
≈ 7.6 GB
Mac memory
16 GB+

mit · updated 2025-07-11

Megac4ai-command-r-plus-4bit

from CohereLabs/c4ai-command-r-plus
4-bit
Text generation · Cohere ↓ 34 · ♥ 0
Params
160B
Weights
≈ 90.2 GB
Mac memory
128 GB+

cc-by-nc-4.0 · updated 2024-05-16

Mellum-4b-sft-kotlin

from JetBrains/Mellum-4b-sft-kotlin
Text generation · JetBrains ↓ 34 · ♥ 0
Params
4.0B
Weights
≈ 8.0 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-06-28

Mellum-4b-sft-kotlin-8bit

from JetBrains/Mellum-4b-sft-kotlin
8-bit
Text generation · JetBrains ↓ 34 · ♥ 0
Params
4.0B
Weights
≈ 4.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-06-28

Mellum2-12B-A2.5B-Thinking-6bit

from JetBrains/Mellum2-12B-A2.5B-Thinking
6-bit
Text generation · JetBrains ↓ 34 · ♥ 0
Params
12B
Weights
≈ 9.9 GB
Mac memory
16 GB+

apache-2.0 · updated 2026-08-11

MiLMMT-46-12B-v0.1-4bit

from xiaomi-research/MiLMMT-46-12B-v0.1
4-bit
Translation · xiaomi-research ↓ 34 · ♥ 0
Params
13B
Weights
≈ 7.2 GB
Mac memory
16 GB+

gemma · updated 2026-07-21

Ministral-3-3B-Reasoning-2512-6bit

from mistralai/Ministral-3-3B-Base-2512
6-bit
Uncategorised · Mistral ↓ 34 · ♥ 0
Params
3.8B
Weights
≈ 3.6 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-12-03

Ministral-3-8B-Reasoning-2512-bf16

from mistralai/Ministral-3-8B-Base-2512
bf16
Uncategorised · Mistral ↓ 34 · ♥ 0
Params
8.9B
Weights
≈ 17.8 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-12-03

MisoLabs-MisoTTS-8bit

mlx-community/MisoLabs-MisoTTS-8bit
8-bit
Uncategorised ↓ 34 · ♥ 0
Params
8.2B
Weights
≈ 2.9 GB
Mac memory
8 GB+

updated 2026-06-03

Mistral-Small-24B-Instruct-2501-6bit

from mistralai/Mistral-Small-24B-Instruct-2501
6-bit
Uncategorised · Mistral ↓ 34 · ♥ 0
Params
24B
Weights
≈ 19.2 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-01-30

MolmoPoint-8B-fp16

from Qwen/Qwen3-8B
fp16
Vision + text · Qwen ↓ 34 · ♥ 0
Params
8.7B
Weights
≈ 17.4 GB
Mac memory
24 GB+

apache-2.0 · updated 2026-03-21

MolmoPoint-8B-mxfp8

from Qwen/Qwen3-8B
MXFP8
Vision + text · Qwen ↓ 34 · ♥ 0
Params
8.7B
Weights
≈ 10.7 GB
Mac memory
16 GB+

apache-2.0 · updated 2026-03-21

Nanbeige4.1-3B-heretic-4bit

from Daizee/Nanbeige4.1-3B-heretic
4-bit
Text generation · Daizee ↓ 34 · ♥ 0
Params
3.9B
Weights
≈ 2.2 GB
Mac memory
8 GB+

apache-2.0 · updated 2026-02-16

NeoHorse-1-9B-oQ6e

mlx-community/NeoHorse-1-9B-oQ6e
6-bit
Uncategorised ↓ 34 · ♥ 0
Params
9.2B
Weights
≈ 7.5 GB
Mac memory
16 GB+

updated 2026-09-08

OLMoE-1B-7B-0125-6bit

from allenai/OLMoE-1B-7B-0125
6-bit
Text generation · Ai2 · OLMo ↓ 34 · ♥ 0
Params
6.9B
Weights
≈ 5.6 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-03-05

Olmo-3-7B-Instruct-SFT-4bit

from allenai/Olmo-3-7B-Instruct-SFT
4-bit
Text generation · Ai2 · OLMo ↓ 34 · ♥ 0
Params
7.3B
Weights
≈ 4.1 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-11-20

Qwen2-VL-2B-bf16

mlx-community/Qwen2-VL-2B-bf16
bf16
Vision + text ↓ 34 · ♥ 0
Params
2.2B
Weights
≈ 4.4 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-03-24

Qwen2.5-Math-1.5B-Instruct-8bit

from Qwen/Qwen2.5-Math-1.5B
8-bit
Text generation · Qwen ↓ 34 · ♥ 0
Params
1.5B
Weights
≈ 1.6 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-09-18

Qwen3-0.6B-gabliterated-8bit

from Goekdeniz-Guelmez/Qwen3-0.6B-gabliterated
8-bit
Text generation · Goekdeniz-Guelmez ↓ 34 · ♥ 0
Params
596M
Weights
≈ 633 MB
Mac memory
8 GB+

updated 2026-01-06

Qwen3-ForcedAligner-0.6B-6bit

mlx-community/Qwen3-ForcedAligner-0.6B-6bit
6-bit
Uncategorised ↓ 34 · ♥ 0
Params
918M
Weights
≈ 1.1 GB
Mac memory
8 GB+

apache-2.0 · updated 2026-01-29

SWE-Fixer-Editor-72B-4bit

from internlm/SWE-Fixer-Editor-72B
4-bit
Text generation · InternLM ↓ 34 · ♥ 0
Params
73B
Weights
≈ 40.9 GB
Mac memory
48 GB+

mit · updated 2025-01-19

SmallThinker-3B-Preview-6bit

from Tiiny/SmallThinker-3B-Preview
6-bit
Text generation · Tiiny ↓ 34 · ♥ 0
Params
3.1B
Weights
≈ 2.5 GB
Mac memory
8 GB+

updated 2025-02-27

Teuken-7B-instruct-v0.6-4bit-mlx

from openGPT-X/Teuken-7B-instruct-v0.6
4-bit
Text generation · openGPT-X ↓ 34 · ♥ 0
Params
7.5B
Weights
≈ 4.2 GB
Mac memory
8 GB+

cc-by-nc-4.0 · updated 2026-03-20

Trinity-Large-Thinking-4bit

from arcee-ai/Trinity-Large-Thinking
4-bit
Text generation · arcee-ai ↓ 34 · ♥ 0
Params
399B
Weights
≈ 224 GB
Mac memory
256 GB+

apache-2.0 · updated 2026-04-02

Yi-9B-q

mlx-community/Yi-9B-q
Text generation ↓ 34 · ♥ 0
Params
8.8B
Weights
≈ 34.8 GB
Mac memory
48 GB+

yi-license · updated 2024-03-06

deepcogito-cogito-v1-preview-qwen-32B-8bit

from deepcogito/cogito-v1-preview-qwen-32B
8-bit
Text generation · deepcogito ↓ 34 · ♥ 0
Params
33B
Weights
≈ 34.8 GB
Mac memory
48 GB+

apache-2.0 · updated 2025-04-09

dots.ocr-nvfp4

mlx-community/dots.ocr-nvfp4
4-bit
Vision + text ↓ 34 · ♥ 0
Params
3.0B
Weights
≈ 3.5 GB
Mac memory
8 GB+

mit · updated 2026-02-17

gemma-2-27b-bf16-8bit

from google/gemma-2-27b
8-bit
Text generation · Google · Gemma ↓ 34 · ♥ 0
Params
27B
Weights
≈ 28.9 GB
Mac memory
48 GB+

gemma · updated 2024-10-22

gemma-4-12B-it-assistant-5bit

from google/gemma-4-12B-it-assistant
5-bit
Any to any · Google · Gemma ↓ 34 · ♥ 0
Params
423M
Weights
≈ 291 MB
Mac memory
8 GB+

apache-2.0 · updated 2026-06-03

gemma-4-E2B-it-qat-assistant-5bit

from google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant
5-bit
Text generation · Google · Gemma ↓ 34 · ♥ 0
Params
78M
Weights
≈ 54 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

gemma-4-E4B-it-CEVRL-8bit

mlx-community/gemma-4-E4B-it-CEVRL-8bit
8-bit
Text generation ↓ 34 · ♥ 0
Params
7.5B
Weights
≈ 7.9 GB
Mac memory
16 GB+

updated 2026-06-16

granite-4.0-1b-5bit

from ibm-granite/granite-4.0-1b
5-bit
Text generation · IBM · Granite ↓ 34 · ♥ 0
Params
1.6B
Weights
≈ 1.1 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-28

granite-4.0-350m-5bit

from ibm-granite/granite-4.0-350m
5-bit
Text generation · IBM · Granite ↓ 34 · ♥ 0
Params
352M
Weights
≈ 242 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-28

llama2-70b-qnt4bit

mlx-community/llama2-70b-qnt4bit
Text generation ↓ 34 · ♥ 0
Params
69B
Weights
≈ 275 GB
Mac memory
512 GB+

updated 2024-04-08

nanoLLaVA-4bit

mlx-community/nanoLLaVA-4bit
4-bit
Uncategorised ↓ 34 · ♥ 0
Params
1.1B
Weights
≈ 1.4 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-12-26

paligemma2-28b-mix-448-6bit

mlx-community/paligemma2-28b-mix-448-6bit
6-bit
Vision + text ↓ 34 · ♥ 0
Params
28B
Weights
≈ 23.0 GB
Mac memory
32 GB+

gemma · updated 2025-02-20

phi-4-abliterated-6bit

from huihui-ai/phi-4-abliterated
6-bit
Text generation · huihui-ai ↓ 34 · ♥ 0
Params
15B
Weights
≈ 11.9 GB
Mac memory
16 GB+

mit · updated 2025-01-09

sarvam-m-8bit

from sarvamai/sarvam-m
8-bit
Text generation · sarvamai ↓ 34 · ♥ 0
Params
24B
Weights
≈ 25.0 GB
Mac memory
32 GB+

apache-2.0 · updated 2025-05-27

shisa-v2-qwen2.5-32b-8bit

from shisa-ai/shisa-v2-qwen2.5-32b
8-bit
Text generation · shisa-ai ↓ 34 · ♥ 0
Params
33B
Weights
≈ 34.8 GB
Mac memory
48 GB+

apache-2.0 · updated 2025-04-14

simplescaling-s1-32B-fp16

from simplescaling/s1-32B
fp16
Text generation · simplescaling ↓ 34 · ♥ 0
Params
33B
Weights
≈ 65.5 GB
Mac memory
96 GB+

apache-2.0 · updated 2025-02-11

whisper-base-fp16

from openai/whisper-base
fp16
Speech recognition · OpenAI · gpt-oss ↓ 34 · ♥ 0
Params
72M
Weights
≈ 144 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-12-15

whisper-base-mlx-fp32

mlx-community/whisper-base-mlx-fp32
fp32
Uncategorised ↓ 34 · ♥ 0
Params
—
Weights
—
Mac memory
—

updated 2024-03-09

whisper-base.en-mlx-fp32

mlx-community/whisper-base.en-mlx-fp32
fp32
Uncategorised ↓ 34 · ♥ 0
Params
—
Weights
—
Mac memory
—

updated 2024-03-09

Qwen3-235B-A22B-Thinking-2507-4bit-DWQ

from Qwen/Qwen3-235B-A22B-Thinking-2507
4-bit DWQ
Text generation · Qwen ↓ 33 · ♥ 4
Params
235B
Weights
≈ 132 GB
Mac memory
192 GB+

apache-2.0 · updated 2025-07-27

Arcee-Agent-8bit

mlx-community/Arcee-Agent-8bit
8-bit
Uncategorised ↓ 33 · ♥ 3
Params
2.1B
Weights
≈ 2.5 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-07-03

Hunyuan-A13B-Instruct-5bit

from tencent/Hunyuan-A13B-Instruct
5-bit
Text generation · tencent ↓ 33 · ♥ 3
Params
80B
Weights
≈ 55.3 GB
Mac memory
64 GB+

tencent-hunyuan-a13b · updated 2025-07-04

TenyxChat-7B-v1-4bit-mlx

mlx-community/TenyxChat-7B-v1-4bit-mlx
4-bit
Text generation ↓ 33 · ♥ 3
Params
—
Weights
—
Mac memory
—

apache-2.0 · updated 2024-01-16

Phi-3-small-8k-instruct-AQ4_32

mlx-community/Phi-3-small-8k-instruct-AQ4_32
Text generation ↓ 33 · ♥ 2
Params
7.4B
Weights
≈ 29.6 GB
Mac memory
48 GB+

mit · updated 2024-05-31

dolphin-2.9-llama3-8b-256-8bit

mlx-community/dolphin-2.9-llama3-8b-256-8bit
8-bit
Uncategorised ↓ 33 · ♥ 2
Params
8.0B
Weights
≈ 8.5 GB
Mac memory
16 GB+

llama3 · updated 2024-04-28