Apple MLX models

phi-4-6bit

from microsoft/phi-4

6-bit

Text generation · Microsoft · Phi ↓ 182 · ♥ 7

Params

15B

Weights

≈ 11.9 GB

Mac memory

16 GB+

mit · updated 2025-01-12

Qwen3-14B-4bit-AWQ

from unsloth/Qwen3-14B

4-bit

Text generation · unsloth ↓ 182 · ♥ 5

Params

15B

Weights

≈ 8.3 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-08-29

Hy-MT2-1.8B-Abliterated-8bit

from tencent/Hy-MT2-1.8B

8-bit

Translation · tencent ↓ 182 · ♥ 3

Params

1.8B

Weights

≈ 1.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-06-02

granite-4.0-1b-4bit

from ibm-granite/granite-4.0-1b

4-bit

Text generation · IBM · Granite ↓ 182 · ♥ 1

Params

1.6B

Weights

≈ 918 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-28

Jev-Style-0.8B-Decision-v3-mlx-16bit

from chaoliangUNSW/Jev-Style-0.8B-Decision-v3

16-bit

Text classification · chaoliangUNSW ↓ 182 · ♥ 0

Params

752M

Weights

≈ 1.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-14

GLM-4.7-Flash-4bit-mxfp4

from zai-org/GLM-4.7-Flash

MXFP4

Text generation · zai-org ↓ 181 · ♥ 4

Params

30B

Weights

≈ 16.9 GB

Mac memory

24 GB+

mit · updated 2026-02-10

Qwen3.5-397B-A17B-6bit

mlx-community/Qwen3.5-397B-A17B-6bit

6-bit

Vision + text ↓ 181 · ♥ 2

Params

397B

Weights

≈ 323 GB

Mac memory

512 GB+

apache-2.0 · updated 2026-02-19

AREX-2-8bit

from BAAI/AREX-2

8-bit

Vision + text · BAAI ↓ 181 · ♥ 1

Params

27B

Weights

≈ 29.5 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-10-07

NVIDIA-Nemotron-3-Super-120B-A12B-6bit

from nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

6-bit

Text generation · NVIDIA ↓ 181 · ♥ 1

Params

121B

Weights

≈ 98.1 GB

Mac memory

128 GB+

nvidia-nemotron-open-model-license · updated 2026-03-30

whisper-base-mlx-4bit

mlx-community/whisper-base-mlx-4bit

4-bit

Uncategorised ↓ 181 · ♥ 1

Params

—

Weights

—

Mac memory

—

updated 2024-03-09

Muse-Glimmer-30B-5bit

from meta-models/Muse-Glimmer-30B

5-bit

Vision + text · meta-models ↓ 181 · ♥ 0

Params

30B

Weights

≈ 22.9 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-08-10

Qwen3.5-4B-mxfp4

mlx-community/Qwen3.5-4B-mxfp4

MXFP4

Uncategorised ↓ 181 · ♥ 0

Params

1.1B

Weights

≈ 1.1 GB

Mac memory

8 GB+

updated 2026-03-02

IQuest-Coder-V1-40B-Loop-Instruct-4bit

from IQuestLab/IQuest-Coder-V1-40B-Loop-Instruct

4-bit

Text generation · IQuestLab ↓ 180 · ♥ 11

Params

40B

Weights

≈ 22.4 GB

Mac memory

32 GB+

iquestcoder · updated 2026-01-07

Meta-Llama-3.1-70B-Instruct-bf16

from meta-llama/Llama-3.1-70B-Instruct

bf16

Text generation · Meta · Llama ↓ 180 · ♥ 4

Params

71B

Weights

≈ 141 GB

Mac memory

192 GB+

llama3.1 · updated 2024-10-06

Devstral-Small-2505-bf16

from mistralai/Devstral-Small-2505

bf16

Text generation · Mistral ↓ 180 · ♥ 1

Params

24B

Weights

≈ 47.1 GB

Mac memory

64 GB+

apache-2.0 · updated 2025-05-21

Qwen3.5-122B-A10B-OptiQ-2bit-REAP-63B

from mlx-community/Qwen3.5-122B-A10B-OptiQ-2bit

2-bit

Text generation ↓ 180 · ♥ 1

Params

65B

Weights

≈ 20.9 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-09-15

Confucius4-TTS-mlx-int8

from netease-youdao/Confucius4-TTS

Text to speech · netease-youdao ↓ 180 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-06-20

Llama-3.2-3B-Instruct-abliterated-6bit

from huihui-ai/Llama-3.2-3B-Instruct-abliterated

6-bit

Text generation · huihui-ai ↓ 180 · ♥ 0

Params

3.2B

Weights

≈ 2.6 GB

Mac memory

8 GB+

llama3.2 · updated 2025-04-23

Qwen2.5-Math-7B-Instruct-4bit

from Qwen/Qwen2.5-Math-7B-Instruct

4-bit

Text generation · Qwen ↓ 180 · ♥ 0

Params

7.6B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

Qwen3-Coder-30B-A3B-Instruct-8bit-DWQ-lr2e7

from Qwen/Qwen3-Coder-30B-A3B-Instruct

8-bit DWQ

Text generation · Qwen ↓ 180 · ♥ 0

Params

31B

Weights

≈ 32.4 GB

Mac memory

48 GB+

apache-2.0 · updated 2025-08-01

sam-audio-small

from facebook/sam-audio-small

Audio to audio · facebook ↓ 179 · ♥ 7

Params

602M

Weights

≈ 2.4 GB

Mac memory

8 GB+

other · updated 2025-12-23

Qwen3-VL-4B-Instruct-3bit

mlx-community/Qwen3-VL-4B-Instruct-3bit

3-bit

Vision + text ↓ 179 · ♥ 5

Params

4.4B

Weights

≈ 2.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-14

DeepSeek-Prover-V2-7B-4bit

from deepseek-ai/DeepSeek-Prover-V2-7B

4-bit

Text generation · DeepSeek ↓ 179 · ♥ 4

Params

6.9B

Weights

≈ 3.9 GB

Mac memory

8 GB+

updated 2025-05-01

Kimi-K2.5-mlx-DQ3_K_M-q8

from moonshotai/Kimi-K2.5

8-bit

Text generation · Moonshot · Kimi ↓ 179 · ♥ 3

Params

1.0T

Weights

≈ 1091 GB

Mac memory

> 512 GB

modified-mit · updated 2026-02-21

TinyLlama-1.1B-Chat-v1.0-4bit

mlx-community/TinyLlama-1.1B-Chat-v1.0-4bit

4-bit

Uncategorised ↓ 179 · ♥ 2

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2024-01-05

MiMo-V2.5-ASR-MLX

from XiaomiMiMo/MiMo-V2.5-ASR

4-bit

Speech recognition · XiaomiMiMo ↓ 179 · ♥ 1

Params

8.0B

Weights

≈ 4.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-05-30

all-MiniLM-L6-v2-bf16

mlx-community/all-MiniLM-L6-v2-bf16

bf16

Sentence similarity ↓ 179 · ♥ 1

Params

23M

Weights

≈ 45 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-02

Huihui-gemma-4-12B-it-qat-q4_0-unquantized-abliterated-5bit-msq

from google/gemma-4-12B-it-qat-q4_0-unquantized

5-bit

Any to any · Google · Gemma ↓ 179 · ♥ 0

Params

12B

Weights

≈ 3.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-06-15

Qwopus3.8-27B-Flash-V2-6bit

from Jackrong/Qwopus3.8-27B-Flash-V2

6-bit

Vision + text · Jackrong ↓ 179 · ♥ 0

Params

27B

Weights

≈ 22.8 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-09-22

deepcogito-cogito-v1-preview-llama-3B-4bit

from deepcogito/cogito-v1-preview-llama-3B

4-bit

Text generation · deepcogito ↓ 179 · ♥ 0

Params

3.2B

Weights

≈ 1.8 GB

Mac memory

8 GB+

llama3.2 · updated 2025-04-08

gemma-4-31b-it-mxfp8

from google/gemma-4-31B-it

MXFP8

Vision + text · Google · Gemma ↓ 178 · ♥ 9

Params

31B

Weights

≈ 33.8 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-07-05

DeepSeek-R1-Distill-Llama-70B

from deepseek-ai/DeepSeek-R1-Distill-Llama-70B

Uncategorised · DeepSeek ↓ 178 · ♥ 6

Params

71B

Weights

≈ 141 GB

Mac memory

192 GB+

updated 2025-02-26

Llama-4-Scout-17B-16E-Instruct-8bit

from meta-llama/Llama-4-Scout-17B-16E

8-bit

Vision + text · Meta · Llama ↓ 178 · ♥ 4

Params

—

Weights

—

Mac memory

—

llama4 · updated 2025-05-03

Qwen2.5-VL-3B-Instruct-bf16

from Qwen/Qwen2.5-VL-3B-Instruct

bf16

Vision + text · Qwen ↓ 178 · ♥ 4

Params

3.8B

Weights

≈ 7.5 GB

Mac memory

16 GB+

updated 2025-02-26

Nemotron-Parse-2.0-4bit

from nvidia/NVIDIA-Nemotron-Parse-2.0

4-bit

Vision + text · NVIDIA ↓ 178 · ♥ 0

Params

977M

Weights

≈ 1.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-08-12

Qwen3.5-4B-mixed_4_8

mlx-community/Qwen3.5-4B-mixed_4_8

4-bit

Uncategorised ↓ 178 · ♥ 0

Params

1.1B

Weights

≈ 1.3 GB

Mac memory

8 GB+

updated 2026-03-02

gemma-2-9b-8bit

mlx-community/gemma-2-9b-8bit

8-bit

Text generation ↓ 177 · ♥ 9

Params

9.2B

Weights

≈ 9.8 GB

Mac memory

16 GB+

gemma · updated 2024-06-27

Qwen3-4B-4bit-DWQ

from Qwen/Qwen3-4B

4-bit DWQ

Text generation · Qwen ↓ 177 · ♥ 4

Params

4.0B

Weights

≈ 2.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-05-31

Qwen2.5-0.5B-Instruct-8bit

from Qwen/Qwen2.5-0.5B

8-bit

Text generation · Qwen ↓ 177 · ♥ 0

Params

494M

Weights

≈ 525 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

gemma-4-E2B-it-qat-8bit

mlx-community/gemma-4-E2B-it-qat-8bit

8-bit

Vision + text ↓ 177 · ♥ 0

Params

5.1B

Weights

≈ 5.9 GB

Mac memory

16 GB+

updated 2026-06-05

whisper-small.en-mlx-4bit

mlx-community/whisper-small.en-mlx-4bit

4-bit

Uncategorised ↓ 177 · ♥ 0

Params

—

Weights

—

Mac memory

—

updated 2024-03-09

Inkling-Small-mxfp4

from thinkingmachines/Inkling-Small

MXFP4

Vision + text · thinkingmachines ↓ 176 · ♥ 4

Params

264B

Weights

≈ 149 GB

Mac memory

192 GB+

updated 2026-07-30

Mistral-Small-24B-Instruct-2501-abliterated-4-bit

from huihui-ai/Mistral-Small-24B-Instruct-2501-abliterated

4-bit

Text generation · huihui-ai ↓ 176 · ♥ 1

Params

24B

Weights

≈ 13.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-02-20

Qwen2.5-Math-1.5B-Instruct-4bit

from Qwen/Qwen2.5-Math-1.5B-Instruct

4-bit

Text generation · Qwen ↓ 176 · ♥ 0

Params

1.5B

Weights

≈ 869 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

nomicai-modernbert-embed-base-6bit

from answerdotai/ModernBERT-base

6-bit

Sentence similarity · answerdotai ↓ 176 · ♥ 0

Params

149M

Weights

≈ 121 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-02

Llama-3-8B-Instruct-1048k-8bit

mlx-community/Llama-3-8B-Instruct-1048k-8bit

8-bit

Text generation ↓ 175 · ♥ 17

Params

8.0B

Weights

≈ 8.5 GB

Mac memory

16 GB+

llama3 · updated 2024-04-29

MiniMax-M2-4bit

from MiniMaxAI/MiniMax-M2

4-bit

Text generation · MiniMaxAI ↓ 175 · ♥ 10

Params

229B

Weights

≈ 129 GB

Mac memory

192 GB+

mit · updated 2025-10-28

medgemma-1.5-4b-it-8bit

mlx-community/medgemma-1.5-4b-it-8bit

8-bit

Vision + text ↓ 175 · ♥ 2

Params

5.0B

Weights

≈ 5.7 GB

Mac memory

16 GB+

health-ai-developer-foundations · updated 2026-01-14

whisper-large-v3-turbo-german-f16-q4

from primeline/whisper-large-v3-german

4-bit

Speech recognition · primeline ↓ 175 · ♥ 2

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2024-10-12

ACE-Step-1.5-turbo-bf16

from ACE-Step/Ace-Step1.5

bf16

Text to audio · ACE-Step ↓ 175 · ♥ 0

Params

2.4B

Weights

≈ 4.8 GB

Mac memory

8 GB+

mit · updated 2026-10-28

GLM-5.2-fp8

mlx-community/GLM-5.2-fp8

8-bit

Text generation ↓ 175 · ♥ 0

Params

743B

Weights

≈ 790 GB

Mac memory

> 512 GB

updated 2026-06-22

Qwen2.5-VL-7B-Instruct-bf16

from Qwen/Qwen2.5-VL-7B-Instruct

bf16

Vision + text · Qwen ↓ 174 · ♥ 4

Params

8.3B

Weights

≈ 16.6 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-02-26

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-DSpark-bf16

from nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16

bf16

Text generation · NVIDIA ↓ 174 · ♥ 1

Params

968M

Weights

≈ 1.9 GB

Mac memory

8 GB+

openmdw-1.1 · updated 2026-08-11

sam-audio-large-fp16

from facebook/sam-audio-large

fp16

Audio to audio · facebook ↓ 173 · ♥ 8

Params

3.0B

Weights

≈ 6.1 GB

Mac memory

16 GB+

other · updated 2025-12-24

medgemma-27b-text-it-bf16

from google/medgemma-27b-text-it

bf16

Text generation · Google · Gemma ↓ 173 · ♥ 4

Params

28B

Weights

≈ 56.8 GB

Mac memory

96 GB+

health-ai-developer-foundations · updated 2025-06-09

Laguna-S-2.1-oQ4e-fast

from poolside/Laguna-S-2.1

4-bit

Text generation · poolside ↓ 173 · ♥ 3

Params

118B

Weights

≈ 66.2 GB

Mac memory

96 GB+

openmdw-1.1 · updated 2026-07-24

NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-4Bit

from nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16

4-bit

Text generation · NVIDIA ↓ 173 · ♥ 1

Params

4.9B

Weights

≈ 4.2 GB

Mac memory

8 GB+

nvidia-open-model-license · updated 2025-12-17

Qwen2.5-VL-7B-Instruct-3bit

from Qwen/Qwen2.5-VL-7B-Instruct

3-bit

Vision + text · Qwen ↓ 173 · ♥ 1

Params

8.3B

Weights

≈ 4.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-02-25

Devstral-Small-2507-4bit-DWQ

from mlx-community/Devstral-Samll-2507-bf16

4-bit DWQ

Text generation ↓ 172 · ♥ 12

Params

24B

Weights

≈ 13.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-07-12

Llama-4-Maverick-17B-16E-Instruct-4bit

from meta-llama/Llama-4-Maverick-17B-128E-Instruct

4-bit

Text generation · Meta · Llama ↓ 172 · ♥ 7

Params

401B

Weights

≈ 225 GB

Mac memory

256 GB+

llama4 · updated 2025-04-06