Apple MLX models

Ministral-3-14B-Instruct-2512-8bit

from mistralai/Ministral-3-14B-Base-2512

8-bit

Uncategorised · Mistral ↓ 350 · ♥ 1

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-12-03

Qwen3-Next-80B-A3B-Thinking-8bit

from Qwen/Qwen3-Next-80B-A3B-Thinking

8-bit

Text generation · Qwen ↓ 349 · ♥ 4

Params

80B

Weights

≈ 84.7 GB

Mac memory

128 GB+

apache-2.0 · updated 2025-09-13

Qwen3.5-0.8B-6bit

from Qwen/Qwen3.5-0.8B-Base

6-bit

Vision + text · Qwen ↓ 349 · ♥ 0

Params

853M

Weights

≈ 813 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-02

OmniVoice-4bit

from k2-fsa/OmniVoice

4-bit

Text to speech · k2-fsa ↓ 348 · ♥ 3

Params

316M

Weights

≈ 192 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-05-30

Qwen3-8B-6bit

from Qwen/Qwen3-8B

6-bit

Text generation · Qwen ↓ 345 · ♥ 4

Params

8.2B

Weights

≈ 6.7 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-04-28

DeepSeek-V4-Pro-Qwen3.5-9B-6bit

from Jackrong/DeepSeek-V4-Pro-Qwen3.5-9B

6-bit

Vision + text · Jackrong ↓ 344 · ♥ 1

Params

9.4B

Weights

≈ 8.2 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-08-07

Unlimited-OCR-2-6bit

from baidu/Unlimited-OCR-2

6-bit

Vision + text · baidu ↓ 343 · ♥ 1

Params

3.3B

Weights

≈ 3.2 GB

Mac memory

8 GB+

mit · updated 2026-10-27

Nemotron-3-Ultra-550B-A55B-4bit

from nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16

4-bit

Text generation · NVIDIA ↓ 341 · ♥ 5

Params

549B

Weights

≈ 313 GB

Mac memory

512 GB+

nvidia-open-model-license · updated 2026-06-05

gemma-4-26B-A4B-it-qat-q4_0-mlx-aligned

from google/gemma-4-26B-A4B-it-qat-q4_0-unquantized

4-bit

Text generation · Google · Gemma ↓ 341 · ♥ 3

Params

25B

Weights

≈ 14.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-07-06

RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-mlx-4bit-msq

from huihui-ai/Huihui-Qwen3.6-35B-A3B-Claude-4.7-Opus-abliterated

4-bit

Text generation · huihui-ai ↓ 339 · ♥ 4

Params

35B

Weights

≈ 19.5 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-06-18

Qwen3-VL-Embedding-2B-4bit

from Qwen/Qwen3-VL-2B-Instruct

4-bit

Embeddings · Qwen ↓ 338 · ♥ 2

Params

2.1B

Weights

≈ 1.8 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-13

SenseNova-U1.5-8B-MoT-8step-4bit

from sensenova/SenseNova-U1.5-8B-MoT

4-bit

Any to any · sensenova ↓ 337 · ♥ 3

Params

18B

Weights

≈ 11.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-11

Qwen3.8-27B-MTP-nvfp4

from Qwen/Qwen3.8-27B

4-bit

Text generation · Qwen ↓ 337 · ♥ 2

Params

425M

Weights

≈ 239 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-11-11

NVIDIA-Nemotron-Nano-9B-v2-6bit

from nvidia/NVIDIA-Nemotron-Nano-9B-v2

6-bit

Text generation · NVIDIA ↓ 337 · ♥ 1

Params

1.9B

Weights

≈ 1.9 GB

Mac memory

8 GB+

nvidia-open-model-license · updated 2025-09-05

Llama-3.2-3B-Fluxed

from VincentGOURBIN/Llama-3.2-3B-Fluxed

Text generation · VincentGOURBIN ↓ 336 · ♥ 3

Params

3.2B

Weights

≈ 6.4 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-12-03

gemma-3-12b-it-8bit

from google/gemma-3-12b-pt

8-bit

Vision + text · Google · Gemma ↓ 336 · ♥ 2

Params

—

Weights

—

Mac memory

—

gemma · updated 2025-03-19

MOSS-TTS-Local-Transformer-v1.5-4bit

from OpenMOSS-Team/MOSS-TTS-Local-Transformer-v1.5

4-bit

Text to speech · OpenMOSS-Team ↓ 336 · ♥ 0

Params

4.6B

Weights

≈ 2.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-09-02

Qwen-AgentWorld-35B-A3B-oQ4

from Qwen/Qwen-AgentWorld-35B-A3B

4-bit

Text generation · Qwen ↓ 335 · ♥ 13

Params

35B

Weights

≈ 19.5 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-06-27

whisper-large-v3-turbo-asr-8bit

mlx-community/whisper-large-v3-turbo-asr-8bit

8-bit

Uncategorised ↓ 335 · ♥ 1

Params

807M

Weights

≈ 864 MB

Mac memory

8 GB+

updated 2026-01-14

NVIDIA-Nemotron-3-Nano-4B-OptiQ-4bit

from nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16

4-bit

Text generation · NVIDIA ↓ 334 · ♥ 3

Params

4.0B

Weights

≈ 2.2 GB

Mac memory

8 GB+

nvidia-nemotron-open-model-license · updated 2026-09-14

Llama-Guard-3-1B-chat-mlx-16bit

from meta-llama/Llama-Guard-3-1B

16-bit

Text generation · Meta · Llama ↓ 334 · ♥ 0

Params

1.5B

Weights

≈ 3.0 GB

Mac memory

8 GB+

llama3.2 · updated 2026-10-14

MOSS-Audio-Tokenizer-v2-bf16

from OpenMOSS-Team/MOSS-Audio-Tokenizer-v2

bf16

Uncategorised · OpenMOSS-Team ↓ 334 · ♥ 0

Params

2.1B

Weights

≈ 4.2 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-09-02

DeepSeek-Coder-V2-Instruct-AQ4_1

mlx-community/DeepSeek-Coder-V2-Instruct-AQ4_1

Uncategorised ↓ 332 · ♥ 4

Params

236B

Weights

≈ 943 GB

Mac memory

> 512 GB

deepseek-license · updated 2024-07-17

whisper-large-v3-turbo-fp16

from openai/whisper-large-v3-turbo

fp16

Speech recognition · OpenAI · gpt-oss ↓ 332 · ♥ 3

Params

807M

Weights

≈ 1.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-12-15

Apertus-8B-Instruct-2509-bf16

from swiss-ai/Apertus-8B-Instruct-2509

bf16

Text generation · swiss-ai ↓ 331 · ♥ 6

Params

8.1B

Weights

≈ 16.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-09-03

LFM2.5-2.6B-OptiQ-4bit

from LiquidAI/LFM2.5-2.6B

4-bit

Text generation · LiquidAI ↓ 330 · ♥ 2

Params

2.7B

Weights

≈ 1.5 GB

Mac memory

8 GB+

lfm1.0 · updated 2026-10-14

DeepSeek-OCR-2-4bit

mlx-community/DeepSeek-OCR-2-4bit

4-bit

Vision + text ↓ 329 · ♥ 2

Params

3.4B

Weights

≈ 2.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-28

SeedVR2-3B-mlx-int8

mlx-community/SeedVR2-3B-mlx-int8

Image to image ↓ 328 · ♥ 5

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-06-06

gemma-4-12B-it-qat-bf16

mlx-community/gemma-4-12B-it-qat-bf16

bf16

Vision + text ↓ 327 · ♥ 0

Params

12B

Weights

≈ 23.9 GB

Mac memory

32 GB+

updated 2026-06-05

clef-flash-OptiQ-4bit

from Cloudflare/clef-flash

4-bit

Text classification · Cloudflare ↓ 326 · ♥ 3

Params

9.0B

Weights

≈ 6.0 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-23

embeddinggemma-2-nvfp4

from google/embeddinggemma-2

4-bit

Embeddings · Google · Gemma ↓ 325 · ♥ 2

Params

744M

Weights

≈ 1.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-06

Qwen2.5-Coder-14B-Instruct-abliterated-6bit

from huihui-ai/Qwen2.5-Coder-14B-Instruct-abliterated

6-bit

Text generation · huihui-ai ↓ 324 · ♥ 0

Params

15B

Weights

≈ 12.0 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-02-22

Mixtral-8x7B-Instruct-v0.1-4bit

mlx-community/Mixtral-8x7B-Instruct-v0.1-4bit

4-bit

Uncategorised ↓ 323 · ♥ 1

Params

47B

Weights

≈ 26.3 GB

Mac memory

32 GB+

apache-2.0 · updated 2024-05-10

Qwen2.5-Coder-7B-Instruct-3bit

from Qwen/Qwen2.5-Coder-7B-Instruct

3-bit

Text generation · Qwen ↓ 323 · ♥ 0

Params

7.6B

Weights

≈ 3.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-12-14

GLM-4.5-Air-bf16

from zai-org/GLM-4.5-Air

bf16

Text generation · zai-org ↓ 322 · ♥ 0

Params

107B

Weights

≈ 214 GB

Mac memory

256 GB+

mit · updated 2025-10-07

embeddinggemma-2-6bit

from google/embeddinggemma-2

6-bit

Embeddings · Google · Gemma ↓ 321 · ♥ 3

Params

744M

Weights

≈ 1.2 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-06

gemma-4-31B-it-qat-8bit

mlx-community/gemma-4-31B-it-qat-8bit

8-bit

Vision + text ↓ 320 · ♥ 3

Params

31B

Weights

≈ 33.8 GB

Mac memory

48 GB+

updated 2026-06-05

LFM2-2.6B-Exp-4bit

from LiquidAI/LFM2-2.6B-Exp

4-bit

Text generation · LiquidAI ↓ 320 · ♥ 1

Params

2.6B

Weights

≈ 1.4 GB

Mac memory

8 GB+

lfm1.0 · updated 2025-12-26

Ming-3.0-tts-tiny-bf16

from inclusionAI/Ming-3.0-tts-tiny

bf16

Text to speech · inclusionAI ↓ 318 · ♥ 1

Params

9.0B

Weights

≈ 18.0 GB

Mac memory

24 GB+

mit · updated 2026-10-19

Mage-VL-8bit

from microsoft/Mage-VL

8-bit

Vision + text · Microsoft · Phi ↓ 317 · ♥ 10

Params

4.7B

Weights

≈ 5.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-07-29

Hi3Dv1.0-mlx

from hi3d-official/Hi3Dv1.0

Image to 3D · hi3d-official ↓ 317 · ♥ 7

Params

4.3B

Weights

≈ 10.2 GB

Mac memory

16 GB+

hi3d-open-license-1.0 · updated 2026-10-23

Llama-3.2-11B-Vision-Instruct-abliterated-8-bit

from meta-llama/Llama-3.2-11B-Vision-Instruct

8-bit

Vision + text · Meta · Llama ↓ 317 · ♥ 1

Params

11B

Weights

≈ 11.3 GB

Mac memory

16 GB+

llama3.2 · updated 2024-12-16

Phonon-2

from FermionResearch/Phonon-2

Speech recognition · FermionResearch ↓ 316 · ♥ 1

Params

99M

Weights

≈ 350 MB

Mac memory

8 GB+

cc-by-4.0 · updated 2026-10-16

Huihui-Qwen3.5-35B-A3B-abliterated-6bit

from huihui-ai/Huihui-Qwen3.5-35B-A3B-abliterated

6-bit

Text generation · huihui-ai ↓ 315 · ♥ 4

Params

35B

Weights

≈ 28.2 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-03-04

Chatterbox-TTS-8bit

from ResembleAI/chatterbox

8-bit

Text to speech · ResembleAI ↓ 315 · ♥ 3

Params

680M

Weights

≈ 1.2 GB

Mac memory

8 GB+

updated 2025-12-05

Josiefied-Qwen2.5-7B-Instruct-abliterated-v2-4-bit

from Goekdeniz-Guelmez/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2

4-bit

Text generation · Goekdeniz-Guelmez ↓ 315 · ♥ 3

Params

7.6B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-12-08

OmniVoice

from k2-fsa/OmniVoice

Text to speech · k2-fsa ↓ 315 · ♥ 3

Params

613M

Weights

≈ 2.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-05-30

Qwen2.5-Coder-14B-Instruct-bf16

from Qwen/Qwen2.5-Coder-14B-Instruct

bf16

Text generation · Qwen ↓ 315 · ♥ 2

Params

15B

Weights

≈ 29.5 GB

Mac memory

48 GB+

apache-2.0 · updated 2024-11-11

parakeet-ctc-1.1b

from nvidia/parakeet-ctc-1.1b

Speech recognition · NVIDIA ↓ 315 · ♥ 1

Params

1.1B

Weights

≈ 4.3 GB

Mac memory

8 GB+

cc-by-4.0 · updated 2025-05-10

ColGrep-Agent-2B-MLX-8bit

from lightonai/colgrep-agent-2B

8-bit

Text generation · lightonai ↓ 315 · ♥ 0

Params

2.5B

Weights

≈ 2.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-19

Mellum2-12B-A2.5B-Thinking-4bit

from JetBrains/Mellum2-12B-A2.5B-Thinking

4-bit

Text generation · JetBrains ↓ 314 · ♥ 4

Params

12B

Weights

≈ 6.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-08-11

quantized-gemma-7b-it

mlx-community/quantized-gemma-7b-it

Text generation ↓ 312 · ♥ 6

Params

8.5B

Weights

≈ 32.6 GB

Mac memory

48 GB+

gemma-terms-of-use · updated 2024-02-22

deepseek-coder-6.7b-instruct-hf-4bit-mlx

mlx-community/deepseek-coder-6.7b-instruct-hf-4bit-mlx

4-bit

Uncategorised ↓ 312 · ♥ 0

Params

—

Weights

—

Mac memory

—

deepseek · updated 2024-01-05

MiMo-V2-Flash-4bit

from XiaomiMiMo/MiMo-V2-Flash

4-bit

Text generation · XiaomiMiMo ↓ 311 · ♥ 8

Params

309B

Weights

≈ 174 GB

Mac memory

256 GB+

mit · updated 2025-12-17

Hy-Memory-30B-A3B-8bit

from tencent/Hy-Memory-30B-A3B

8-bit

Text generation · tencent ↓ 311 · ♥ 1

Params

30B

Weights

≈ 32.0 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-10-21

Qwen2.5-72B-Instruct-8bit

from Qwen/Qwen2.5-72B

8-bit

Text generation · Qwen ↓ 309 · ♥ 4

Params

73B

Weights

≈ 77.3 GB

Mac memory

96 GB+

qwen · updated 2024-09-19

VibeVoice-ASR-8bit

mlx-community/VibeVoice-ASR-8bit

8-bit

Speech recognition ↓ 309 · ♥ 4

Params

8.3B

Weights

≈ 9.5 GB

Mac memory

16 GB+

mit · updated 2026-01-23

Astrea-R8-Chat-9B-OptiQ-4bit

from HemmingwayAI/Astrea-R8-Chat-9B

4-bit

Vision + text · HemmingwayAI ↓ 309 · ♥ 2

Params

9.0B

Weights

≈ 6.0 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-23

Ornith-1.0-9B-OptiQ-4bit

from ornith-ai/Ornith-1.0-9B

4-bit

Vision + text · ornith-ai ↓ 308 · ♥ 9

Params

9.0B

Weights

≈ 6.0 GB

Mac memory

16 GB+

mit · updated 2026-10-18

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-8bit

from nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

8-bit

Vision + text · NVIDIA ↓ 308 · ♥ 2

Params

33B

Weights

≈ 35.8 GB

Mac memory

48 GB+

nvidia-open-model-agreement · updated 2026-04-29