Apple MLX models

Voxtral-4B-TTS-2603-mlx-6bit

from mistralai/Voxtral-4B-TTS-2603

6-bit

Text to speech · Mistral ↓ 1.8K · ♥ 5

Params

4.0B

Weights

≈ 3.5 GB

Mac memory

8 GB+

cc-by-nc-4.0 · updated 2026-03-27

Josiefied-Qwen3-1.7B-abliterated-v1-4bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-1.7B-abliterated-v1

4-bit

Text generation · Goekdeniz-Guelmez ↓ 1.8K · ♥ 3

Params

1.7B

Weights

≈ 968 MB

Mac memory

8 GB+

updated 2025-04-29

DeepSeek-V3-0324-4bit

from deepseek-ai/DeepSeek-v3-0324

4-bit

Text generation · DeepSeek ↓ 1.8K · ♥ 40

Params

671B

Weights

≈ 378 GB

Mac memory

512 GB+

mit · updated 2025-08-20

MiniCPM5-2B-8bit

from openbmb/MiniCPM5-2B

8-bit

Text generation · openbmb ↓ 1.8K · ♥ 9

Params

2.5B

Weights

≈ 2.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-09-10

Qwen2.5-7B-Instruct-Uncensored-4bit

from Orion-zhen/Qwen2.5-7B-Instruct-Uncensored

4-bit

Text generation · Orion-zhen ↓ 1.8K · ♥ 8

Params

7.6B

Weights

≈ 4.3 GB

Mac memory

8 GB+

gpl-3.0 · updated 2024-10-21

Kimi-Dev-72B-4bit-DWQ

from moonshotai/Kimi-Dev-72B

4-bit DWQ

Text generation · Moonshot · Kimi ↓ 1.8K · ♥ 22

Params

73B

Weights

≈ 40.9 GB

Mac memory

48 GB+

mit · updated 2025-07-12

Qwen2.5-0.5B-Instruct-bf16

from Qwen/Qwen2.5-0.5B

bf16

Text generation · Qwen ↓ 1.8K · ♥ 1

Params

494M

Weights

≈ 988 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

Qwen2.5-VL-72B-Instruct-4bit

from Qwen/Qwen2.5-VL-72B-Instruct

4-bit

Vision + text · Qwen ↓ 1.8K · ♥ 11

Params

73B

Weights

≈ 42.3 GB

Mac memory

64 GB+

qwen · updated 2025-02-25

VoxCPM2-4bit

from openbmb/VoxCPM2

4-bit

Text to speech · openbmb ↓ 1.8K · ♥ 13

Params

2.4B

Weights

≈ 2.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-08

gemma-3-12b-it-bf16

from google/gemma-3-12b-pt

bf16

Vision + text · Google · Gemma ↓ 1.7K · ♥ 2

Params

13B

Weights

≈ 26.4 GB

Mac memory

32 GB+

gemma · updated 2025-03-19

DeepSeek-R1-Distill-Llama-70B-4bit

from deepseek-ai/DeepSeek-R1-Distill-Llama-70B

4-bit

Text generation · DeepSeek ↓ 1.7K · ♥ 13

Params

71B

Weights

≈ 39.7 GB

Mac memory

48 GB+

updated 2025-02-26

Qwen3.5-0.8B-decision

from Qwen/Qwen3.5-0.8B

Text classification · Qwen ↓ 1.7K · ♥ 7

Params

873M

Weights

≈ 1.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-23

diffusiongemma-26B-A4B-it-4bit

from google/diffusiongemma-26B-A4B-it

4-bit

Vision + text · Google · Gemma ↓ 1.7K · ♥ 37

Params

26B

Weights

≈ 15.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-07-15

Qwen3.5-9B-bf16

from Qwen/Qwen3.5-9B-Base

bf16

Vision + text · Qwen ↓ 1.7K · ♥ 5

Params

9.4B

Weights

≈ 18.8 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-03-02

nomicai-modernbert-embed-base-bf16

from answerdotai/ModernBERT-base

bf16

Sentence similarity · answerdotai ↓ 1.7K · ♥ 1

Params

149M

Weights

≈ 298 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-02

Muse-Glimmer-30B-8bit

from meta-models/Muse-Glimmer-30B

8-bit

Vision + text · meta-models ↓ 1.7K · ♥ 4

Params

30B

Weights

≈ 33.4 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-08-10

Qwen3-4B-8bit

from Qwen/Qwen3-4B

8-bit

Text generation · Qwen ↓ 1.7K · ♥ 1

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-28

DeepSeek-OCR-8bit

mlx-community/DeepSeek-OCR-8bit

8-bit

Vision + text ↓ 1.7K · ♥ 38

Params

3.3B

Weights

≈ 3.9 GB

Mac memory

8 GB+

mit · updated 2026-01-28

Mistral-Small-3.2-24B-Instruct-2506-4bit

from mlx-community/Mistral-Small-3.2-24B-Instruct-2506-bf16

4-bit

Text generation ↓ 1.7K · ♥ 1

Params

24B

Weights

≈ 13.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-06-21

Qwen3.6-35B-A3B-DFlash2-4bit

from incoai/Qwen3.6-35B-A3B-Splash

4-bit

Text generation · incoai ↓ 1.7K · ♥ 10

Params

526M

Weights

≈ 479 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-09-25

Qwen3.5-35B-A3B-8bit

mlx-community/Qwen3.5-35B-A3B-8bit

8-bit

Vision + text ↓ 1.7K · ♥ 23

Params

35B

Weights

≈ 37.7 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-02-24

Qwen3.5-4B-MLX-8bit

from Qwen/Qwen3.5-4B

8-bit

Uncategorised · Qwen ↓ 1.7K · ♥ 16

Params

4.5B

Weights

≈ 5.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-02

DeepSeek-R1-4bit

from deepseek-ai/DeepSeek-R1

4-bit

Uncategorised · DeepSeek ↓ 1.7K · ♥ 39

Params

671B

Weights

≈ 378 GB

Mac memory

512 GB+

updated 2025-02-26

OmniVoice-bfloat16

from k2-fsa/OmniVoice

Text to speech · k2-fsa ↓ 1.7K · ♥ 2

Params

613M

Weights

≈ 1.2 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-05-30

llama-3.3-70b-instruct-fp16

from meta-llama/Llama-3.3-70B-Instruct

fp16

Text generation · Meta · Llama ↓ 1.7K · ♥ 1

Params

71B

Weights

≈ 141 GB

Mac memory

192 GB+

llama3.3 · updated 2025-03-22

Qwen3.5-122B-A10B-bf16

mlx-community/Qwen3.5-122B-A10B-bf16

bf16

Vision + text ↓ 1.7K · ♥ 2

Params

123B

Weights

≈ 245 GB

Mac memory

512 GB+

apache-2.0 · updated 2026-02-25

Qwen3-ForcedAligner-0.6B-4bit

mlx-community/Qwen3-ForcedAligner-0.6B-4bit

4-bit

Uncategorised ↓ 1.6K · ♥ 0

Params

918M

Weights

≈ 971 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-29

whisper-tiny-asr-fp16

mlx-community/whisper-tiny-asr-fp16

fp16

Speech recognition ↓ 1.6K · ♥ 0

Params

37M

Weights

≈ 74 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-15

Qwen3-TTS-12Hz-0.6B-CustomVoice-6bit

mlx-community/Qwen3-TTS-12Hz-0.6B-CustomVoice-6bit

6-bit

Text to speech ↓ 1.6K · ♥ 0

Params

906M

Weights

≈ 1.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-25

gemma-3-1b-it-bf16

from google/gemma-3-1b-it

bf16

Text generation · Google · Gemma ↓ 1.6K · ♥ 1

Params

1.3B

Weights

≈ 2.6 GB

Mac memory

8 GB+

gemma · updated 2025-03-12

silero-vad

mlx-community/silero-vad

Audio classification ↓ 1.6K · ♥ 3

Params

544K

Weights

≈ 2 MB

Mac memory

8 GB+

updated 2026-04-30

Kokoro-82M-8bit

from yl4579/StyleTTS2-LJSpeech

8-bit

Text to speech · yl4579 ↓ 1.6K · ♥ 9

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-01-05

Ming-3.0-tts-0.5B-8bit

from inclusionAI/Ming-3.0-tts-0.5B

8-bit

Text to speech · inclusionAI ↓ 1.6K · ♥ 2

Params

1.5B

Weights

≈ 1.6 GB

Mac memory

8 GB+

mit · updated 2026-10-22

DeepSeek-V4.1-Flash-1017-oQ3e-mtp

from deepseek-ai/DeepSeek-V4.1-Flash-1017

Vision + text · DeepSeek ↓ 1.6K · ♥ 1

Params

112B

Weights

≈ 381 GB

Mac memory

512 GB+

mit · updated 2026-10-29

Qwen3.6-35B-A3B-mxfp8

from Qwen/Qwen3.6-35B-A3B

MXFP8

Vision + text · Qwen ↓ 1.6K · ♥ 8

Params

35B

Weights

≈ 37.7 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-05-14

gemma-3-270m-it-4bit

from google/gemma-3-270m-it

4-bit

Text generation · Google · Gemma ↓ 1.6K · ♥ 10

Params

268M

Weights

≈ 151 MB

Mac memory

8 GB+

gemma · updated 2025-08-14

Qwen3.5-397B-A17B-nvfp4

from Qwen/Qwen3.5-397B-A17B

4-bit

Text generation · Qwen ↓ 1.6K · ♥ 6

Params

396B

Weights

≈ 223 GB

Mac memory

256 GB+

apache-2.0 · updated 2026-02-16

Kimi-K2-Thinking

from moonshotai/Kimi-K2-Thinking

4-bit

Text generation · Moonshot · Kimi ↓ 1.6K · ♥ 17

Params

1.0T

Weights

≈ 594 GB

Mac memory

> 512 GB

modified-mit · updated 2025-11-07

Qwen3.5-4B-nvfp4

mlx-community/Qwen3.5-4B-nvfp4

4-bit

Uncategorised ↓ 1.6K · ♥ 1

Params

1.4B

Weights

≈ 1.3 GB

Mac memory

8 GB+

updated 2026-03-02

DeepSeek-V4-Pro-Qwen3.5-9B-4bit

from Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B

4-bit

Vision + text · Jackrong ↓ 1.6K · ♥ 4

Params

9.4B

Weights

≈ 6.0 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-08-07

orpheus-3b-0.1-ft-4bit

from canopylabs/orpheus-3b-0.1-ft

4-bit

Text to speech · canopylabs ↓ 1.6K · ♥ 4

Params

3.3B

Weights

≈ 1.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-03-21

Kimi-K3-mlx-reap160-2bit

from moonshotai/Kimi-K3

2-bit

Text generation · Moonshot · Kimi ↓ 1.6K · ♥ 2

Params

543B

Weights

≈ 170 GB

Mac memory

256 GB+

other · updated 2026-08-03

Qwen2.5-Coder-7B-Instruct-8bit

from Qwen/Qwen2.5-Coder-7B

8-bit

Text generation · Qwen ↓ 1.5K · ♥ 1

Params

7.6B

Weights

≈ 8.1 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-09-18

gemma-4-31b-it-bf16

from google/gemma-4-31B-it

bf16

Vision + text · Google · Gemma ↓ 1.5K · ♥ 14

Params

31B

Weights

≈ 62.5 GB

Mac memory

96 GB+

apache-2.0 · updated 2026-07-05

Breeze-TTS-2-mlx-8bit

from BreezeBlue/Breeze-TTS-2

8-bit

Text to speech · BreezeBlue ↓ 1.5K · ♥ 5

Params

3.5B

Weights

≈ 4.0 GB

Mac memory

8 GB+

breezeblue-research-and-non-commercial-license · updated 2026-08-26

Mistral-Small-3.1-24B-Instruct-2503-4bit

from mistralai/Mistral-Small-3.1-24B-Base-2503

4-bit

Uncategorised · Mistral ↓ 1.5K · ♥ 9

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-03-19

DeepSeek-R1-Distill-Qwen-32B-MLX-8Bit

from deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

8-bit

Uncategorised · DeepSeek ↓ 1.5K · ♥ 18

Params

33B

Weights

≈ 34.8 GB

Mac memory

48 GB+

updated 2025-02-26

chatterbox-turbo-8bit

from ResembleAI/chatterbox-turbo

8-bit

Text to speech · ResembleAI ↓ 1.5K · ♥ 1

Params

626M

Weights

≈ 706 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-12-17

MiniCPM5-1B-OptiQ-4bit

from openbmb/MiniCPM5-1B

4-bit

Text generation · openbmb ↓ 1.5K · ♥ 11

Params

1.1B

Weights

≈ 608 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-07-14

Qwen3.6-27B-nvfp4

from Qwen/Qwen3.6-27B

4-bit

Vision + text · Qwen ↓ 1.5K · ♥ 9

Params

27B

Weights

≈ 16.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-04-22

Mistral-Medium-3.5-128B-4bit

mlx-community/Mistral-Medium-3.5-128B-4bit

4-bit

Vision + text ↓ 1.5K · ♥ 5

Params

128B

Weights

≈ 78.0 GB

Mac memory

96 GB+

updated 2026-04-30

Spark-TTS-0.5B-bf16

mlx-community/Spark-TTS-0.5B-bf16

bf16

Text to speech ↓ 1.5K · ♥ 4

Params

507M

Weights

≈ 1.0 GB

Mac memory

8 GB+

cc-by-nc-sa-4.0 · updated 2025-05-10

Qwen3-VL-30B-A3B-Instruct-4bit

mlx-community/Qwen3-VL-30B-A3B-Instruct-4bit

4-bit

Vision + text ↓ 1.5K · ♥ 9

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-11

pocket-tts

from kyutai/pocket-tts

Uncategorised · kyutai ↓ 1.5K · ♥ 7

Params

118M

Weights

≈ 236 MB

Mac memory

8 GB+

cc-by-4.0 · updated 2026-02-06

gemma-4-e2b-it-bf16

from google/gemma-4-E2B-it

bf16

Vision + text · Google · Gemma ↓ 1.5K · ♥ 1

Params

5.1B

Weights

≈ 10.2 GB

Mac memory

16 GB+

gemma · updated 2026-07-06

PaddleOCR-VL-1.6-4bit

from PaddlePaddle/PaddleOCR-VL-1.6

4-bit

Vision + text · PaddlePaddle ↓ 1.5K · ♥ 3

Params

906M

Weights

≈ 703 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-08-12

Qwen3.5-35B-A3B-bf16

mlx-community/Qwen3.5-35B-A3B-bf16

bf16

Vision + text ↓ 1.5K · ♥ 1

Params

35B

Weights

≈ 70.2 GB

Mac memory

96 GB+

apache-2.0 · updated 2026-02-24

gemma-3n-E4B-it-lm-4bit

from google/gemma-3n-E4B-it

4-bit

Text generation · Google · Gemma ↓ 1.5K · ♥ 8

Params

6.9B

Weights

≈ 3.9 GB

Mac memory

8 GB+

gemma · updated 2025-06-29

translategemma-12b-it-4bit

from google/translategemma-12b-it

4-bit

Text generation · Google · Gemma ↓ 1.5K · ♥ 6

Params

12B

Weights

≈ 6.6 GB

Mac memory

16 GB+

gemma · updated 2026-01-16

Qwen3.5-27B-bf16

mlx-community/Qwen3.5-27B-bf16

bf16

Vision + text ↓ 1.5K · ♥ 0

Params

27B

Weights

≈ 54.7 GB

Mac memory

64 GB+

apache-2.0 · updated 2026-02-24