Apple MLX models

Olmo-3.1-32B-Think-8bit

from allenai/Olmo-3.1-32B-Think

8-bit

Text generation · Ai2 · OLMo ↓ 395 · ♥ 0

Params

32B

Weights

≈ 34.2 GB

Mac memory

48 GB+

apache-2.0 · updated 2025-12-24

olmOCR-2-7B-1025-5bit

from Qwen/Qwen2.5-VL-7B-Instruct

5-bit

Vision + text · Qwen ↓ 394 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-25

Qwen3.8-27B-oQ6

mlx-community/Qwen3.8-27B-oQ6

6-bit

Uncategorised ↓ 393 · ♥ 2

Params

27B

Weights

≈ 22.8 GB

Mac memory

32 GB+

updated 2026-08-16

gemma-4-26B-A4B-it-heretic-msq-2.6bit

from google/gemma-4-26B-A4B-it

6-bit

Vision + text · Google · Gemma ↓ 392 · ♥ 10

Params

26B

Weights

≈ 21.7 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-05-19

LFM2.5-24B-A2B-Preview-4bit

from lq-preview/LFM2.5-24B-A2B-Preview

4-bit

Text generation · lq-preview ↓ 392 · ♥ 0

Params

24B

Weights

≈ 13.5 GB

Mac memory

24 GB+

lfm1.0 · updated 2026-10-13

flint-oQ2.7e

from RecursiveSI/flint

2-bit

Text generation · RecursiveSI ↓ 392 · ♥ 0

Params

40B

Weights

≈ 12.5 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-27

MiniCPM-V-4.7-1B-bf16

from openbmb/MiniCPM-V-4.7-1B

bf16

Vision + text · openbmb ↓ 390 · ♥ 1

Params

1.6B

Weights

≈ 3.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-13

Dolphin-Mistral-24B-Venice-Edition-DWQ

from dphn/Dolphin-Mistral-24B-Venice-Edition

4-bit

Text generation · dphn ↓ 389 · ♥ 5

Params

24B

Weights

≈ 13.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-07-07

Ornith-1.5-9B-oQ6e-mtp

mlx-community/Ornith-1.5-9B-oQ6e-mtp

6-bit

Uncategorised ↓ 388 · ♥ 0

Params

9.7B

Weights

≈ 8.4 GB

Mac memory

16 GB+

updated 2026-09-16

DeepSeek-OCR-4bit

mlx-community/DeepSeek-OCR-4bit

4-bit

Vision + text ↓ 387 · ♥ 9

Params

3.3B

Weights

≈ 2.5 GB

Mac memory

8 GB+

mit · updated 2026-01-28

Qwen-Image-2512-5bit

from Qwen/Qwen-Image-2512

5-bit

Text to image · Qwen ↓ 386 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-01-01

from primeline/whisper-large-v3-german

Speech recognition · primeline ↓ 378 · ♥ 3

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2024-10-12

VibeVoice-Realtime-0.5B-fp16

from Qwen/Qwen2.5-0.5B

fp16

Text to speech · Qwen ↓ 377 · ♥ 5

Params

1.0B

Weights

≈ 2.0 GB

Mac memory

8 GB+

mit · updated 2025-12-15

gemma-4-E4B-it-qat-assistant-4bit

from google/gemma-4-E4B-it-qat-q4_0-unquantized-assistant

4-bit

Text generation · Google · Gemma ↓ 377 · ♥ 1

Params

79M

Weights

≈ 45 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

Ornith-1.0-35B-4bit

from ornith-ai/Ornith-1.0-35B

4-bit

Vision + text · ornith-ai ↓ 376 · ♥ 16

Params

35B

Weights

≈ 20.4 GB

Mac memory

32 GB+

mit · updated 2026-06-27

Qwen3.5-35B-A3B-OptiQ-4bit-REAP-19B

from mlx-community/Qwen3.5-35B-A3B-OptiQ-4bit

4-bit

Text generation ↓ 376 · ♥ 4

Params

19B

Weights

≈ 11.3 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-30

GOT-OCR2_0-4bit

from stepfun-ai/GOT-OCR2_0

4-bit

Vision + text · stepfun-ai ↓ 376 · ♥ 0

Params

561M

Weights

≈ 454 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-08-14

MiniMax-Music3-mxfp8

from MiniMaxAI/MiniMax-Music3

MXFP8

Text to audio · MiniMaxAI ↓ 375 · ♥ 5

Params

12B

Weights

≈ 14.2 GB

Mac memory

24 GB+

minimax-music3-community-license · updated 2026-08-16

flint-oQ2.5e

from RecursiveSI/flint

2-bit

Text generation · RecursiveSI ↓ 373 · ♥ 0

Params

40B

Weights

≈ 12.5 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-27

gemma-4-26b-a4b-it-nvfp4

from google/gemma-4-26B-A4B-it

4-bit

Vision + text · Google · Gemma ↓ 371 · ♥ 17

Params

26B

Weights

≈ 15.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-07-05

Laguna-XS-2.1-OptiQ-4bit

from poolside/Laguna-XS-2.1

4-bit

Text generation · poolside ↓ 371 · ♥ 3

Params

33B

Weights

≈ 18.8 GB

Mac memory

24 GB+

openmdw-1.1 · updated 2026-10-16

NVIDIA-Nemotron-3-Super-120B-A12B-OptiQ-2bit

from nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16

2-bit

Text generation · NVIDIA ↓ 371 · ♥ 2

Params

121B

Weights

≈ 37.9 GB

Mac memory

48 GB+

nvidia-nemotron-open-model-license · updated 2026-09-15

Groot-19B-A3B-OptiQ-4bit

from GrootTeam/Groot-19B-A3B-261023

4-bit

Vision + text · GrootTeam ↓ 371 · ♥ 1

Params

19B

Weights

≈ 11.3 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-11-05

gemma-4-12B-it-qat-nvfp4

mlx-community/gemma-4-12B-it-qat-nvfp4

4-bit

Vision + text ↓ 370 · ♥ 1

Params

12B

Weights

≈ 6.7 GB

Mac memory

16 GB+

updated 2026-06-05

Ming-3.0-tts-tiny-4bit

from inclusionAI/Ming-3.0-tts-tiny

4-bit

Uncategorised · inclusionAI ↓ 370 · ♥ 0

Params

9.0B

Weights

≈ 6.6 GB

Mac memory

16 GB+

mit · updated 2026-10-19

Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-oQ4-mtp-MLX

mlx-community/Qwen3.8-27B-TWIN-TURBO-Fable-Cold-Fusion-709-L-Uncensored-oQ4-mtp-MLX

4-bit

Uncategorised ↓ 368 · ♥ 3

Params

28B

Weights

≈ 16.4 GB

Mac memory

24 GB+

updated 2026-09-16

Hy-MT2-1.8B-8bit

from Tencent-Hunyuan/Hy-MT2-1.8B

8-bit

Translation · Tencent-Hunyuan ↓ 368 · ♥ 1

Params

1.8B

Weights

≈ 1.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-05-30

Qwen3.8-27B-MTP-mxfp8

from Qwen/Qwen3.8-27B

MXFP8

Text generation · Qwen ↓ 365 · ♥ 8

Params

425M

Weights

≈ 451 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-11-11

MiniMax-Music3-8bit

from MiniMaxAI/MiniMax-Music3

8-bit

Text to audio · MiniMaxAI ↓ 363 · ♥ 8

Params

12B

Weights

≈ 14.2 GB

Mac memory

24 GB+

minimax-music3-community-license · updated 2026-08-16

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-nvfp4

from nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

4-bit

Any to any · NVIDIA ↓ 361 · ♥ 5

Params

33B

Weights

≈ 19.6 GB

Mac memory

24 GB+

nvidia-open-model-agreement · updated 2026-04-29

K2-Horizon-7B-chat-mlx-16bit

from IFM/K2-Horizon-7B

16-bit

Text generation · IFM ↓ 361 · ♥ 0

Params

9.0B

Weights

≈ 18.0 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-10-14

LensVLM-9B-OptiQ-4bit

from apple/LensVLM-9B

4-bit

Vision + text · apple ↓ 360 · ♥ 5

Params

9.0B

Weights

≈ 6.0 GB

Mac memory

16 GB+

apple-amlr · updated 2026-10-18

Muse-Glimmer-30B-nvfp4

from meta-models/Muse-Glimmer-30B

4-bit

Vision + text · meta-models ↓ 360 · ♥ 2

Params

30B

Weights

≈ 19.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-08-11

Hy-Memory-30B-A3B-4bit

from tencent/Hy-Memory-30B-A3B

4-bit

Text generation · tencent ↓ 360 · ♥ 0

Params

30B

Weights

≈ 16.9 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-10-21

translategemma-27b-it-8bit

from google/translategemma-27b-it

8-bit

Text generation · Google · Gemma ↓ 359 · ♥ 5

Params

27B

Weights

≈ 28.7 GB

Mac memory

48 GB+

gemma · updated 2026-01-16

Irodori-TTS-v4.1-Small-fp16

from Aratako/Irodori-TTS-v4.1-Small

fp16

Text to speech · Aratako ↓ 359 · ♥ 4

Params

766M

Weights

≈ 1.5 GB

Mac memory

8 GB+

updated 2026-08-15

gemma-4-12B-it-mxfp8

mlx-community/gemma-4-12B-it-mxfp8

MXFP8

Vision + text ↓ 359 · ♥ 4

Params

12B

Weights

≈ 12.7 GB

Mac memory

24 GB+

updated 2026-06-08

gemma-4-26b-a4b-4bit

from google/gemma-4-26b-a4b

4-bit

Vision + text · Google · Gemma ↓ 357 · ♥ 20

Params

26B

Weights

≈ 15.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-04-03

ThinkingCap-Qwen3.6-27B-OptiQ-4bit

from bottlecapai/ThinkingCap-Qwen3.6-27B

4-bit

Vision + text · bottlecapai ↓ 357 · ♥ 4

Params

27B

Weights

≈ 16.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-10-30

Qwen3.5-4B-MLX-bf16

from Qwen/Qwen3.5-4B

bf16

Uncategorised · Qwen ↓ 357 · ♥ 1

Params

4.5B

Weights

≈ 9.1 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-03-02

Qwen3.6-27B-Heretic2-Uncensored-Finetune-Thinking-OptiQ-4bit

from DavidAU/Qwen3.6-27B-Heretic2-Uncensored-Finetune-Thinking

4-bit

Text generation · DavidAU ↓ 357 · ♥ 0

Params

27B

Weights

≈ 15.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-09-16

Ornith-1.0-9B-4bit

from ornith-ai/Ornith-1.0-9B

4-bit

Text generation · ornith-ai ↓ 356 · ♥ 10

Params

9.4B

Weights

≈ 6.0 GB

Mac memory

16 GB+

mit · updated 2026-06-28

d1a-e2b-it-qat-4bit

from google/gemma-4-E2B-it-qat-w4a16-ct

4-bit

Text classification · Google · Gemma ↓ 356 · ♥ 2

Params

4.6B

Weights

≈ 2.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-11-11

LFM2-24B-A2B-4bit

from LiquidAI/LFM2-24B-A2B

4-bit

Text generation · LiquidAI ↓ 356 · ♥ 0

Params

24B

Weights

≈ 13.4 GB

Mac memory

24 GB+

lfm1.0 · updated 2026-02-25

OLMo-1B-hf-4bit-mlx

mlx-community/OLMo-1B-hf-4bit-mlx

4-bit

Uncategorised ↓ 356 · ♥ 0

Params

1.2B

Weights

≈ 810 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-02-08

Ternary-Bonsai-2-2B-2bit

from Qwen/Qwen3.5-2B

2-bit

Vision + text · Qwen ↓ 356 · ♥ 0

Params

2.2B

Weights

≈ 1.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-15

embeddinggemma-2-5bit

from google/embeddinggemma-2

5-bit

Embeddings · Google · Gemma ↓ 354 · ♥ 3

Params

744M

Weights

≈ 1.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-06

Qwen3.5-122B-A10B-OptiQ-2bit

from Qwen/Qwen3.5-122B-A10B

2-bit

Vision + text · Qwen ↓ 353 · ♥ 6

Params

122B

Weights

≈ 39.1 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-09-15

MiniCPM-V-4.7-35B-A3B-5bit

from openbmb/MiniCPM-V-4.7-35B-A3B

5-bit

Vision + text · openbmb ↓ 353 · ♥ 1

Params

35B

Weights

≈ 27.6 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-10-13

gemma-4-12B-it-qat-5bit

mlx-community/gemma-4-12B-it-qat-5bit

5-bit

Vision + text ↓ 353 · ♥ 0

Params

12B

Weights

≈ 8.2 GB

Mac memory

16 GB+

updated 2026-06-05

MiniMax-M2.7-4bit

from MiniMaxAI/MiniMax-M2.7

4-bit

Text generation · MiniMaxAI ↓ 351 · ♥ 2

Params

229B

Weights

≈ 129 GB

Mac memory

192 GB+

modified-mit · updated 2026-04-12

Qwen3-8B-4bit-DWQ

from Qwen/Qwen3-8B

4-bit DWQ

Text generation · Qwen ↓ 351 · ♥ 2

Params

8.2B

Weights

≈ 4.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-05-01

embeddinggemma-2-mxfp4

from google/embeddinggemma-2

MXFP4

Embeddings · Google · Gemma ↓ 350 · ♥ 3

Params

744M

Weights

≈ 1.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-06