Skip to content
Apple silicon

Apple MLX models

5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 2h ago. Weights size and Mac memory are estimates from parameter count and quantisation.

Alert me about new Apple/MLX models

2,922 builds · page 35 of 49 · clear filters

SmolLM-360M-Instruct-fp16

mlx-community/SmolLM-360M-Instruct-fp16
fp16
Text generation ↓ 35 · ♥ 1
Params
362M
Weights
≈ 724 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-07-16

Swallow-7b-instruct-v0.1-4bit

mlx-community/Swallow-7b-instruct-v0.1-4bit
4-bit
Text generation ↓ 35 · ♥ 1
Params
6.8B
Weights
≈ 4.1 GB
Mac memory
8 GB+

llama2 · updated 2024-04-27

cogito-v2-preview-llama-70B-4Bit

from deepcogito/cogito-v2-preview-llama-70B
4-bit
Text generation · deepcogito ↓ 35 · ♥ 1
Params
71B
Weights
≈ 39.7 GB
Mac memory
48 GB+

llama3.1 · updated 2025-07-31

granite-4.0-h-1b-8bit

from ibm-granite/granite-4.0-h-1b
8-bit
Text generation · IBM · Granite ↓ 35 · ♥ 1
Params
1.5B
Weights
≈ 1.6 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-10-28

salamandra-7b-instruct-mlx-bf16

from BSC-LT/salamandra-7b-instruct
bf16
Text generation · BSC-LT ↓ 35 · ♥ 1
Params
7.8B
Weights
≈ 15.5 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-08-21

simplescaling-s1.1-32B-8bit

from simplescaling/s1.1-32B
8-bit
Text generation · simplescaling ↓ 35 · ♥ 1
Params
33B
Weights
≈ 34.8 GB
Mac memory
48 GB+

apache-2.0 · updated 2025-02-16

Cydonia-24B-v3-6bit

from TheDrummer/Cydonia-24B-v3
6-bit
Text generation · TheDrummer ↓ 35 · ♥ 0
Params
24B
Weights
≈ 19.2 GB
Mac memory
24 GB+

other · updated 2025-06-04

DeepScaleR-1.5B-Preview-4bit

from agentica-org/DeepScaleR-1.5B-Preview
4-bit
Text generation · agentica-org ↓ 35 · ♥ 0
Params
1.8B
Weights
≈ 1000 MB
Mac memory
8 GB+

mit · updated 2025-02-14

EuroLLM-22B-Instruct-2512-mlx-bf16

from utter-project/EuroLLM-22B-Instruct-2512
bf16
Text generation · utter-project ↓ 35 · ♥ 0
Params
23B
Weights
≈ 45.3 GB
Mac memory
64 GB+

apache-2.0 · updated 2025-12-16

Falcon3-10B-Instruct-1.58bit-8bit

from tiiuae/Falcon3-10B-Instruct-1.58bit
58-bit
Text generation · TII · Falcon ↓ 35 · ♥ 0
Params
2.6B
Weights
≈ 3.2 GB
Mac memory
8 GB+

falcon-llm-license · updated 2025-06-10

Falcon3-3B-Instruct-1.58bit-4bit

from tiiuae/Falcon3-3B-Instruct-1.58bit
58-bit
Text generation · TII · Falcon ↓ 35 · ♥ 0
Params
1.3B
Weights
≈ 1.7 GB
Mac memory
8 GB+

falcon-llm-license · updated 2025-06-10

Hermes-3-Llama-3.2-3B-bf16

from NousResearch/Hermes-3-Llama-3.2-3B
bf16
Text generation · NousResearch ↓ 35 · ♥ 0
Params
3.2B
Weights
≈ 6.4 GB
Mac memory
16 GB+

llama3 · updated 2024-12-11

Jan-v1-4B

from janhq/Jan-v1-4B
Text generation · janhq ↓ 35 · ♥ 0
Params
4.0B
Weights
≈ 8.0 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-08-13

Josiefied-Qwen3-1.7B-abliterated-v1-6bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-1.7B-abliterated-v1
6-bit
Text generation · Goekdeniz-Guelmez ↓ 35 · ♥ 0
Params
1.7B
Weights
≈ 1.4 GB
Mac memory
8 GB+

updated 2025-05-01

LFM2-8B-A1B-6bit

from LiquidAI/LFM2-8B-A1B
6-bit
Text generation · LiquidAI ↓ 35 · ♥ 0
Params
8.3B
Weights
≈ 6.8 GB
Mac memory
16 GB+

lfm1.0 · updated 2025-10-08

Qwen2.5-Math-1.5B-4bit

from Qwen/Qwen2.5-1.5B
4-bit
Text generation · Qwen ↓ 35 · ♥ 0
Params
1.5B
Weights
≈ 869 MB
Mac memory
8 GB+

apache-2.0 · updated 2024-09-18

Qwen3-30B-A3B-Instruct-2507-5bit-DWQ-lr5e-7

from Qwen/Qwen3-30B-A3B-Instruct-2507
5-bit DWQ
Text generation · Qwen ↓ 35 · ♥ 0
Params
31B
Weights
≈ 21.0 GB
Mac memory
32 GB+

apache-2.0 · updated 2025-07-31

SmolLM3-3B-6bit

from HuggingFaceTB/SmolLM3-3B
6-bit
Text generation · Hugging Face ↓ 35 · ♥ 0
Params
3.1B
Weights
≈ 2.5 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-07-08

UserLM-8b-4bit

from microsoft/UserLM-8b
4-bit
Text generation · Microsoft · Phi ↓ 35 · ♥ 0
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

mit · updated 2025-10-09

deepcogito-cogito-v1-preview-qwen-14B-8bit

from deepcogito/cogito-v1-preview-qwen-14B
8-bit
Text generation · deepcogito ↓ 35 · ♥ 0
Params
15B
Weights
≈ 15.7 GB
Mac memory
24 GB+

apache-2.0 · updated 2025-04-08

exaone-4.0-1.2b-8bit

from LGAI-EXAONE/EXAONE-4.0-1.2B
8-bit
Text generation · LGAI-EXAONE ↓ 35 · ♥ 0
Params
1.3B
Weights
≈ 1.4 GB
Mac memory
8 GB+

exaone · updated 2025-07-15

gemma-2-baku-2b-it-8bit

from google/gemma-2-2b
8-bit
Text generation · Google · Gemma ↓ 35 · ♥ 0
Params
2.6B
Weights
≈ 2.8 GB
Mac memory
8 GB+

gemma · updated 2024-10-04

gemma-4-E4B-it-qat-assistant-5bit

from google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant
5-bit
Text generation · Google · Gemma ↓ 35 · ♥ 0
Params
79M
Weights
≈ 55 MB
Mac memory
8 GB+

gemma · updated 2026-06-05

kanana-2-3b-instruct-mixed_4_6

from kakaocorp/kanana-2-3b-instruct
4-bit
Text generation · kakaocorp ↓ 35 · ♥ 0
Params
3.2B
Weights
≈ 1.8 GB
Mac memory
8 GB+

kanana-open-license · updated 2026-08-06

stockmark-100b-8bit

mlx-community/stockmark-100b-8bit
8-bit
Text generation ↓ 35 · ♥ 0
Params
96B
Weights
≈ 102 GB
Mac memory
128 GB+

mit · updated 2024-05-16

LFM2-1.2B-6bit

from LiquidAI/LFM2-1.2B
6-bit
Text generation · LiquidAI ↓ 34 · ♥ 3
Params
1.2B
Weights
≈ 951 MB
Mac memory
8 GB+

lfm1.0 · updated 2025-07-12

Llama-3-70B-Instruct-Gradient-1048k-4bit

mlx-community/Llama-3-70B-Instruct-Gradient-1048k-4bit
4-bit
Text generation ↓ 34 · ♥ 3
Params
71B
Weights
≈ 39.7 GB
Mac memory
48 GB+

llama3 · updated 2024-05-04

GLM-4.6-8bit

from mlx-community/GLM-4.6-bf16
8-bit
Text generation ↓ 34 · ♥ 2
Params
353B
Weights
≈ 375 GB
Mac memory
512 GB+

mit · updated 2025-11-23

MagenticBrain-8bit

from microsoft/MagenticBrain
8-bit
Text generation · Microsoft · Phi ↓ 34 · ♥ 2
Params
15B
Weights
≈ 15.7 GB
Mac memory
24 GB+

mit · updated 2026-07-29

MiniMax-M2-5bit

from MiniMaxAI/MiniMax-M2
5-bit
Text generation · MiniMaxAI ↓ 34 · ♥ 2
Params
229B
Weights
≈ 157 GB
Mac memory
192 GB+

mit · updated 2025-10-29

Hy3-preview-6bit

from tencent/Hy3-preview
6-bit
Text generation · tencent ↓ 34 · ♥ 1
Params
295B
Weights
≈ 240 GB
Mac memory
512 GB+

other · updated 2026-04-27

JOSIE-TinyLlama-1.1B-32k-base-8bit

from Doctor-Shotgun/TinyLlama-1.1B-32k
8-bit
Text generation · Doctor-Shotgun ↓ 34 · ♥ 1
Params
1.1B
Weights
≈ 1.2 GB
Mac memory
8 GB+

updated 2024-05-24

LFM2-350M-6bit

from LiquidAI/LFM2-350M
6-bit
Text generation · LiquidAI ↓ 34 · ♥ 1
Params
354M
Weights
≈ 288 MB
Mac memory
8 GB+

lfm1.0 · updated 2025-07-11

LFM2-700M-bf16

from LiquidAI/LFM2-700M
bf16
Text generation · LiquidAI ↓ 34 · ♥ 1
Params
742M
Weights
≈ 1.5 GB
Mac memory
8 GB+

lfm1.0 · updated 2025-07-11

Llama-3-8B-Instruct-Gradient-1048k-8bit

mlx-community/Llama-3-8B-Instruct-Gradient-1048k-8bit
8-bit
Text generation ↓ 34 · ♥ 1
Params
8.0B
Weights
≈ 8.5 GB
Mac memory
16 GB+

llama3 · updated 2024-05-05

Meta-Llama-3-70B-Instruct-4bit-mlx

mlx-community/Meta-Llama-3-70B-Instruct-4bit-mlx
4-bit
Text generation ↓ 34 · ♥ 1
Params
71B
Weights
≈ 39.7 GB
Mac memory
48 GB+

llama3 · updated 2024-04-20

MiniMax-M2.1-5bit

from MiniMaxAI/MiniMax-M2.1
5-bit
Text generation · MiniMaxAI ↓ 34 · ♥ 1
Params
229B
Weights
≈ 157 GB
Mac memory
192 GB+

modified-mit · updated 2026-01-06

Nex-N2-Pro-nvfp4

from nex-agi/Nex-N2-Pro
4-bit
Text generation · nex-agi ↓ 34 · ♥ 1
Params
397B
Weights
≈ 224 GB
Mac memory
256 GB+

apache-2.0 · updated 2026-06-09

Pleias-RAG-350M-8-bit

from PleIAs/Pleias-RAG-350M
8-bit
Text generation · PleIAs ↓ 34 · ♥ 1
Params
353M
Weights
≈ 376 MB
Mac memory
8 GB+

apache-2.0 · updated 2025-04-24

Qwen2-72B-Instruct-8bit

mlx-community/Qwen2-72B-Instruct-8bit
8-bit
Text generation ↓ 34 · ♥ 1
Params
73B
Weights
≈ 77.3 GB
Mac memory
96 GB+

tongyi-qianwen · updated 2024-06-07

SmolLM-1.7B-Instruct-8bit

mlx-community/SmolLM-1.7B-Instruct-8bit
8-bit
Text generation ↓ 34 · ♥ 1
Params
1.7B
Weights
≈ 1.8 GB
Mac memory
8 GB+

apache-2.0 · updated 2024-07-16

granite-4.1-8b-mxfp8

from ibm-granite/granite-4.1-8b
MXFP8
Text generation · IBM · Granite ↓ 34 · ♥ 1
Params
8.4B
Weights
≈ 8.9 GB
Mac memory
16 GB+

apache-2.0 · updated 2026-05-03

Anubis-70B-v1.1-8bit

from TheDrummer/Anubis-70B-v1.1
8-bit
Text generation · TheDrummer ↓ 34 · ♥ 0
Params
71B
Weights
≈ 75.0 GB
Mac memory
96 GB+

updated 2025-06-28

ArrowCanaria-Llama-8B-SFT-v0.1-MLX-4bit

from DataPilot/ArrowCanaria-Llama-8B-SFT-v0.1
4-bit
Text generation · DataPilot ↓ 34 · ♥ 0
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+

llama3.3 · updated 2026-03-27

DeepHermes-3-Mistral-24B-Preview-bf16

from NousResearch/DeepHermes-3-Mistral-24B-Preview
bf16
Text generation · NousResearch ↓ 34 · ♥ 0
Params
24B
Weights
≈ 47.1 GB
Mac memory
64 GB+

apache-2.0 · updated 2025-03-14

Falcon-H1-Tiny-R-0.6B-pre-GRPO-4bit

from tiiuae/Falcon-H1-Tiny-R-0.6B-pre-GRPO
4-bit
Text generation · TII · Falcon ↓ 34 · ♥ 0
Params
622M
Weights
≈ 351 MB
Mac memory
8 GB+

falcon-llm-license · updated 2026-01-28

Falcon-H1-Tiny-Tool-Calling-90M-8bit

from tiiuae/Falcon-H1-Tiny-Tool-Calling-90M
8-bit
Text generation · TII · Falcon ↓ 34 · ♥ 0
Params
91M
Weights
≈ 97 MB
Mac memory
8 GB+

falcon-llm-license · updated 2026-01-28

Falcon3

from tiiuae/Falcon3-7B-Instruct
4-bit
Text generation · TII · Falcon ↓ 34 · ♥ 0
Params
7.5B
Weights
≈ 4.2 GB
Mac memory
8 GB+

falcon-llm-license · updated 2024-12-17

Falcon3-10B-Instruct-abliterated-6bit

from huihui-ai/Falcon3-10B-Instruct-abliterated
6-bit
Text generation · huihui-ai ↓ 34 · ♥ 0
Params
10B
Weights
≈ 8.4 GB
Mac memory
16 GB+

falcon-llm-license · updated 2025-02-19

Huihui-gemma-3-270m-it-abliterated-fp16

from huihui-ai/Huihui-gemma-3-270m-it-abliterated
fp16
Text generation · huihui-ai ↓ 34 · ♥ 0
Params
268M
Weights
≈ 536 MB
Mac memory
8 GB+

gemma · updated 2025-09-27

Josiefied-Qwen3-0.6B-abliterated-v1-bf16

from Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v1
bf16
Text generation · Goekdeniz-Guelmez ↓ 34 · ♥ 0
Params
596M
Weights
≈ 1.2 GB
Mac memory
8 GB+

updated 2025-04-29

Josiefied-Qwen3-0.6B-abliterated-v2-8bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-abliterated-v2
8-bit
Text generation · Goekdeniz-Guelmez ↓ 34 · ♥ 0
Params
596M
Weights
≈ 633 MB
Mac memory
8 GB+

updated 2026-01-11

Llama-3-8B-Instruct-Gradient-1048k-2bit

mlx-community/Llama-3-8B-Instruct-Gradient-1048k-2bit
2-bit
Text generation ↓ 34 · ♥ 0
Params
8.0B
Weights
≈ 2.5 GB
Mac memory
8 GB+

llama3 · updated 2024-05-05

Llama-3-Swallow-70B-Instruct-v0.1-4bit

mlx-community/Llama-3-Swallow-70B-Instruct-v0.1-4bit
4-bit
Text generation ↓ 34 · ♥ 0
Params
71B
Weights
≈ 39.7 GB
Mac memory
48 GB+

llama3 · updated 2024-07-01

Llama-3.1-Swallow-70B-Instruct-v0.1-8bit

from tokyotech-llm/Llama-3.1-Swallow-70B-Instruct-v0.1
8-bit
Text generation · tokyotech-llm ↓ 34 · ♥ 0
Params
71B
Weights
≈ 75.0 GB
Mac memory
96 GB+

llama3.1 · updated 2024-10-08

MediPhi-Instruct-bf16

from microsoft/MediPhi-Instruct
bf16
Text generation · Microsoft · Phi ↓ 34 · ♥ 0
Params
3.8B
Weights
≈ 7.6 GB
Mac memory
16 GB+

mit · updated 2025-07-11

Megac4ai-command-r-plus-4bit

from CohereLabs/c4ai-command-r-plus
4-bit
Text generation · Cohere ↓ 34 · ♥ 0
Params
160B
Weights
≈ 90.2 GB
Mac memory
128 GB+

cc-by-nc-4.0 · updated 2024-05-16

Mellum-4b-sft-kotlin

from JetBrains/Mellum-4b-sft-kotlin
Text generation · JetBrains ↓ 34 · ♥ 0
Params
4.0B
Weights
≈ 8.0 GB
Mac memory
16 GB+

apache-2.0 · updated 2025-06-28

Mellum-4b-sft-kotlin-8bit

from JetBrains/Mellum-4b-sft-kotlin
8-bit
Text generation · JetBrains ↓ 34 · ♥ 0
Params
4.0B
Weights
≈ 4.3 GB
Mac memory
8 GB+

apache-2.0 · updated 2025-06-28