Apple MLX models

MOSS-TTS-Nano-100M

from OpenMOSS-Team/MOSS-TTS-Nano-100M

Uncategorised · OpenMOSS-Team ↓ 1.2K · ♥ 6

Params

142M

Weights

≈ 285 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-24

Qwen2.5-Coder-7B-4bit

from Qwen/Qwen2.5-7B

4-bit

Text generation · Qwen ↓ 1.2K · ♥ 0

Params

7.6B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

Kimi-K2-Instruct-4bit

from moonshotai/Kimi-K2-Instruct

4-bit

Text generation · Moonshot · Kimi ↓ 1.2K · ♥ 13

Params

1.0T

Weights

≈ 578 GB

Mac memory

> 512 GB

modified-mit · updated 2025-07-11

granite-4.1-3b-4bit

from ibm-granite/granite-4.1-3b

4-bit

Text generation · IBM · Granite ↓ 1.2K · ♥ 0

Params

3.4B

Weights

≈ 1.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-05-01

Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-8Bit

from AEON-7/Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16

8-bit

Text generation · AEON-7 ↓ 1.2K · ♥ 25

Params

27B

Weights

≈ 28.6 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-05-13

Hermes-4-14B-4bit

from NousResearch/Hermes-4-14B

4-bit

Text generation · NousResearch ↓ 1.2K · ♥ 6

Params

15B

Weights

≈ 8.3 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-09-03

Laguna-S-2.1-oQ4e

from poolside/Laguna-S-2.1

4-bit

Text generation · poolside ↓ 1.2K · ♥ 10

Params

118B

Weights

≈ 66.2 GB

Mac memory

96 GB+

openmdw-1.1 · updated 2026-07-24

Mistral-Large-4-1T-A52B-Text-4bit

from mistralai/Mistral-Large-4-1T-A52B

4-bit

Text generation · Mistral ↓ 1.2K · ♥ 1

Params

1.0T

Weights

≈ 590 GB

Mac memory

> 512 GB

mistral-ecosystem-open-weight-license · updated 2026-10-29

gemma-4-E4B-it-assistant-bf16

from google/gemma-4-E4B-it-assistant

bf16

Text generation · Google · Gemma ↓ 1.2K · ♥ 13

Params

79M

Weights

≈ 159 MB

Mac memory

8 GB+

gemma · updated 2026-05-05

Devstral-Small-2-24B-Instruct-2512-OptiQ-4bit

from mistralai/Devstral-Small-2-24B-Instruct-2512

4-bit

Text generation · Mistral ↓ 1.2K · ♥ 4

Params

24B

Weights

≈ 14.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-09-24

nvidia_Llama-3.1-Nemotron-70B-Instruct-HF_4bit

from nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

4-bit

Text generation · NVIDIA ↓ 1.2K · ♥ 12

Params

71B

Weights

≈ 39.7 GB

Mac memory

48 GB+

llama3.1 · updated 2024-10-16

Qwen-Image-2512-6bit

from Qwen/Qwen-Image-2512

6-bit

Text to image · Qwen ↓ 1.2K · ♥ 6

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-01-01

Llama-OuteTTS-1.0-1B-4bit

mlx-community/Llama-OuteTTS-1.0-1B-4bit

4-bit

Text to speech ↓ 1.2K · ♥ 2

Params

1.2B

Weights

≈ 702 MB

Mac memory

8 GB+

cc-by-nc-sa-4.0 · updated 2025-05-19

Qwen3.5-9B-6bit

from Qwen/Qwen3.5-9B-Base

6-bit

Vision + text · Qwen ↓ 1.2K · ♥ 7

Params

9.4B

Weights

≈ 8.2 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-03-02

Soprano-1.1-80M-bf16

from ekwek/Soprano-1.1-80M

bf16

Text to speech · ekwek ↓ 1.2K · ♥ 2

Params

110M

Weights

≈ 281 MB

Mac memory

8 GB+

updated 2026-02-04

Arch-Router-1.5B-mlx-8Bit

from katanemo/Arch-Router-1.5B

8-bit

Text generation · katanemo ↓ 1.2K · ♥ 0

Params

1.5B

Weights

≈ 1.6 GB

Mac memory

8 GB+

katanemo-research · updated 2025-10-17

encodec-24khz-float32

mlx-community/encodec-24khz-float32

Uncategorised ↓ 1.2K · ♥ 0

Params

19M

Weights

≈ 76 MB

Mac memory

8 GB+

other · updated 2024-09-18

MiniMax-M3.1-Flash-oQ4e-mtp

from MiniMaxAI/MiniMax-M3.1-Flash

4-bit

Vision + text · MiniMaxAI ↓ 1.2K · ♥ 4

Params

427B

Weights

≈ 241 GB

Mac memory

512 GB+

minimax-community · updated 2026-10-23

LFM3-1.7B-OptiQ-4bit

from LiquidAI/LFM3-1.7B

4-bit

Text generation · LiquidAI ↓ 1.2K · ♥ 1

Params

1.7B

Weights

≈ 973 MB

Mac memory

8 GB+

lfm1.0 · updated 2026-10-29

Qwen3.6-35B-A3B-4bit-DWQ

mlx-community/Qwen3.6-35B-A3B-4bit-DWQ

4-bit DWQ

Text generation ↓ 1.2K · ♥ 18

Params

35B

Weights

≈ 19.5 GB

Mac memory

24 GB+

updated 2026-04-17

gemma-3n-E2B-it-4bit

from google/gemma-3n-E4B-it

4-bit

Vision + text · Google · Gemma ↓ 1.2K · ♥ 10

Params

5.4B

Weights

≈ 4.5 GB

Mac memory

8 GB+

gemma · updated 2025-07-12

flint-oQ4e

from RecursiveSI/flint

4-bit

Text generation · RecursiveSI ↓ 1.2K · ♥ 2

Params

40B

Weights

≈ 22.4 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-10-27

clef-flash-8bit

from Cloudflare/clef-flash

8-bit

Zero-shot classification · Cloudflare ↓ 1.1K · ♥ 11

Params

9.4B

Weights

≈ 10.4 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-07

MuseTalk-1.5-q4

from TMElyralab/MuseTalk

4-bit

Image to image · TMElyralab ↓ 1.1K · ♥ 3

Params

—

Weights

—

Mac memory

—

mit · updated 2026-06-05

Qwen3-Coder-30B-A3B-Instruct-4bit-dwq-v2

from Qwen/Qwen3-Coder-30B-A3B-Instruct

4-bit DWQ

Text generation · Qwen ↓ 1.1K · ♥ 11

Params

31B

Weights

≈ 17.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-08-09

granite-4.0-h-micro-4bit

from ibm-granite/granite-4.0-h-micro

4-bit

Text generation · IBM · Granite ↓ 1.1K · ♥ 1

Params

3.2B

Weights

≈ 1.8 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-04

Qwen3-Coder-30B-A3B-Instruct-3bit

from Qwen/Qwen3-Coder-30B-A3B-Instruct

3-bit

Text generation · Qwen ↓ 1.1K · ♥ 2

Params

31B

Weights

≈ 13.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-07-31

dolphin3.0-llama3.2-1B-4Bit

from dphn/Dolphin3.0-Llama3.2-1B

4-bit

Uncategorised · dphn ↓ 1.1K · ♥ 0

Params

1.2B

Weights

≈ 695 MB

Mac memory

8 GB+

llama3.2 · updated 2025-08-22

humanizer-12b-OptiQ-4bit

from jialinyyzz/humanizer

4-bit

Text generation · jialinyyzz ↓ 1.1K · ♥ 6

Params

12B

Weights

≈ 6.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-18

Qwen3-4B-Instruct-2507-4bit-DWQ-2510

from Qwen/Qwen3-4B-Instruct-2507

4-bit DWQ

Text generation · Qwen ↓ 1.1K · ♥ 2

Params

4.0B

Weights

≈ 2.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-13

Devstral-Small-2-24B-Instruct-2512-8bit

from mistralai/Devstral-Small-2-24B-Instruct-2512

8-bit

Vision + text · Mistral ↓ 1.1K · ♥ 2

Params

24B

Weights

≈ 26.6 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-07-04

Unlimited-OCR-2-bf16

from baidu/Unlimited-OCR-2

bf16

Vision + text · baidu ↓ 1.1K · ♥ 7

Params

3.3B

Weights

≈ 6.7 GB

Mac memory

16 GB+

mit · updated 2026-10-27

Qwen2.5-Coder-32B-Instruct-abliterated-4bit

from huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated

4-bit

Text generation · huihui-ai ↓ 1.1K · ♥ 1

Params

33B

Weights

≈ 18.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-01-06

whisper-large-v3-mlx-8bit

mlx-community/whisper-large-v3-mlx-8bit

8-bit

Uncategorised ↓ 1.1K · ♥ 5

Params

—

Weights

—

Mac memory

—

updated 2024-03-13

Mistral-Large-4-1T-A52B-Text-2bit

from mistralai/Mistral-Large-4-1T-A52B

2-bit

Text generation · Mistral ↓ 1.1K · ♥ 1

Params

1.0T

Weights

≈ 328 GB

Mac memory

512 GB+

mistral-ecosystem-open-weight-license · updated 2026-10-29

granite-4.0-h-tiny-4bit

from ibm-granite/granite-4.0-h-micro

4-bit

Text generation · IBM · Granite ↓ 1.1K · ♥ 0

Params

6.9B

Weights

≈ 3.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-04

gemma-4-e4b-it-OptiQ-4bit

from google/gemma-4-E4B-it

4-bit

Text generation · Google · Gemma ↓ 1.1K · ♥ 29

Params

7.5B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2026-10-18

gemma-4-e2b-it-OptiQ-4bit-decision

from mlx-community/gemma-4-e2b-it-OptiQ-4bit

4-bit

Text classification ↓ 1.1K · ♥ 5

Params

4.6B

Weights

≈ 2.6 GB

Mac memory

8 GB+

gemma · updated 2026-10-23

olmOCR-2-7B-1025-mlx-4bit

from Qwen/Qwen2.5-VL-7B-Instruct

4-bit

Vision + text · Qwen ↓ 1.1K · ♥ 1

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-29

Qwen2.5-Coder-32B-Instruct-bf16

from Qwen/Qwen2.5-Coder-32B-Instruct

bf16

Text generation · Qwen ↓ 1.1K · ♥ 11

Params

33B

Weights

≈ 65.5 GB

Mac memory

96 GB+

apache-2.0 · updated 2024-11-11

translategemma-12b-it-8bit

from google/translategemma-12b-it

8-bit

Text generation · Google · Gemma ↓ 1.1K · ♥ 8

Params

12B

Weights

≈ 12.5 GB

Mac memory

16 GB+

gemma · updated 2026-01-16

Huihui-Qwen3.5-4B-Claude-4.6-Opus-abliterated-4bit

from Jackrong/Qwen3.5-4B-Claude-4.6-Opus-Reasoning-Distilled

4-bit

Vision + text · Jackrong ↓ 1.1K · ♥ 6

Params

4.5B

Weights

≈ 3.0 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-17

GLM-OCR-8bit

mlx-community/GLM-OCR-8bit

8-bit

Image to text ↓ 1.1K · ♥ 10

Params

1.1B

Weights

≈ 1.6 GB

Mac memory

8 GB+

mit · updated 2026-02-03

Nemotron-3-Diarization

from nvidia/Nemotron-3-Diarization

Voice activity detection · NVIDIA ↓ 1.1K · ♥ 4

Params

99M

Weights

≈ 199 MB

Mac memory

8 GB+

openmdw-1.1 · updated 2026-09-23

gemma-3-27b-it-4bit

from google/gemma-3-27b-pt

4-bit

Vision + text · Google · Gemma ↓ 1.1K · ♥ 13

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-03-19

Qwen3.6-27B-bf16

from Qwen/Qwen3.6-27B

bf16

Vision + text · Qwen ↓ 1.1K · ♥ 7

Params

27B

Weights

≈ 54.7 GB

Mac memory

64 GB+

apache-2.0 · updated 2026-04-22

diar_streaming_sortformer_4spk-v2.1-fp16

from nvidia/diar_streaming_sortformer_4spk-v2.1

fp16

Voice activity detection · NVIDIA ↓ 1.1K · ♥ 2

Params

118M

Weights

≈ 236 MB

Mac memory

8 GB+

updated 2026-02-10

olmOCR-2-7B-1025-4bit

from Qwen/Qwen2.5-VL-7B-Instruct

4-bit

Vision + text · Qwen ↓ 1.1K · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-23

Qwen3.5-2B-bf16

from Qwen/Qwen3.5-2B-Base

bf16

Vision + text · Qwen ↓ 1.1K · ♥ 4

Params

2.2B

Weights

≈ 4.4 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-02

Qwen3.8-27B-nvfp4

from Qwen/Qwen3.8-27B

4-bit

Vision + text · Qwen ↓ 1.1K · ♥ 14

Params

27B

Weights

≈ 16.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-11-11

Qwen2.5-Coder-7B-8bit

from Qwen/Qwen2.5-7B

8-bit

Text generation · Qwen ↓ 1.0K · ♥ 2

Params

7.6B

Weights

≈ 8.1 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-09-18

olmOCR-2-7B-1025-bf16

from Qwen/Qwen2.5-VL-7B-Instruct

bf16

Vision + text · Qwen ↓ 1.0K · ♥ 2

Params

8.3B

Weights

≈ 16.6 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-10-22

olmOCR-2-7B-1025-8bit

from Qwen/Qwen2.5-VL-7B-Instruct

8-bit

Vision + text · Qwen ↓ 1.0K · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-25

Qwen3-Embedding-8B-mxfp8

from Qwen/Qwen3-8B-Base

MXFP8

Embeddings · Qwen ↓ 1.0K · ♥ 4

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-02-11

DeepSeek-R1-Distill-Llama-70B-8bit

from deepseek-ai/DeepSeek-R1-Distill-Llama-70B

8-bit

Uncategorised · DeepSeek ↓ 1.0K · ♥ 11

Params

71B

Weights

≈ 75.0 GB

Mac memory

96 GB+

updated 2025-02-26

MiniCPM5-2B-chat-mlx-4bit

from openbmb/MiniCPM5-2B

4-bit

Text generation · openbmb ↓ 1.0K · ♥ 2

Params

2.5B

Weights

≈ 1.4 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-14

S3TokenizerV3

from FunAudioLLM/Fun-CosyVoice3-0.5B-2512

Uncategorised · FunAudioLLM ↓ 1.0K · ♥ 0

Params

242M

Weights

≈ 968 MB

Mac memory

8 GB+

updated 2025-12-16

Qwen3.8-Flash-Next-oQ8e-mtp

from Qwen/Qwen3.8-Flash-Next

8-bit

Uncategorised · Qwen ↓ 1.0K · ♥ 4

Params

180B

Weights

≈ 192 GB

Mac memory

256 GB+

qwen-community-1.0 · updated 2026-08-31

Phi-3-mini-4k-instruct-4bit

mlx-community/Phi-3-mini-4k-instruct-4bit

4-bit

Text generation ↓ 1.0K · ♥ 12

Params

3.8B

Weights

≈ 2.1 GB

Mac memory

8 GB+

mit · updated 2024-07-11

Qwen3-TTS-12Hz-1.7B-VoiceDesign-6bit

mlx-community/Qwen3-TTS-12Hz-1.7B-VoiceDesign-6bit

6-bit

Text to speech ↓ 1.0K · ♥ 1

Params

1.9B

Weights

≈ 2.0 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-25