Apple MLX models

deepseek-vl2-8bit

mlx-community/deepseek-vl2-8bit

8-bit

Vision + text ↓ 195 · ♥ 6

Params

27B

Weights

≈ 29.3 GB

Mac memory

48 GB+

deepseek · updated 2025-09-04

DeepSeek-V4-Pro-bf16

mlx-community/DeepSeek-V4-Pro-bf16

bf16

Text generation ↓ 195 · ♥ 2

Params

1.6T

Weights

≈ 6241 GB

Mac memory

> 512 GB

updated 2026-05-23

gemma-4-E2B-it-qat-assistant-4bit

from google/gemma-4-E2B-it-qat-q4_0-unquantized-assistant

4-bit

Text generation · Google · Gemma ↓ 195 · ♥ 0

Params

78M

Weights

≈ 45 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

sam-audio-small-fp16

from facebook/sam-audio-small

fp16

Audio to audio · facebook ↓ 194 · ♥ 3

Params

602M

Weights

≈ 1.2 GB

Mac memory

8 GB+

other · updated 2025-12-23

Josiefied-Qwen3-14B-abliterated-v3-8bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-14B-abliterated-v3

8-bit

Text generation · Goekdeniz-Guelmez ↓ 194 · ♥ 2

Params

15B

Weights

≈ 15.7 GB

Mac memory

24 GB+

updated 2025-06-04

deepseek-coder-33b-instruct

from deepseek-ai/deepseek-coder-33b-instruct

4-bit

Text generation · DeepSeek ↓ 194 · ♥ 2

Params

33B

Weights

≈ 18.8 GB

Mac memory

24 GB+

deepseek · updated 2025-06-21

Qwen3-8B-4bit-AWQ

from Qwen/Qwen3-8B

4-bit

Text generation · Qwen ↓ 193 · ♥ 1

Params

8.2B

Weights

≈ 4.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-29

Qwen3-Coder-30B-A3B-Instruct-8bit-DWQ-lr9e8

from Qwen/Qwen3-Coder-30B-A3B-Instruct

8-bit DWQ

Text generation · Qwen ↓ 193 · ♥ 1

Params

31B

Weights

≈ 32.4 GB

Mac memory

48 GB+

apache-2.0 · updated 2025-08-01

diffusiongemma-26B-A4B-it-nvfp4

from google/diffusiongemma-26B-A4B-it

4-bit

Vision + text · Google · Gemma ↓ 192 · ♥ 6

Params

26B

Weights

≈ 15.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-07-15

gemma-3-270m-it-bf16

from google/gemma-3-270m-it

bf16

Text generation · Google · Gemma ↓ 192 · ♥ 2

Params

436M

Weights

≈ 872 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

Josiefied-Qwen3-4B-Instruct-2507-abliterated-v2-4bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-4B-Instruct-2507-abliterated-v2

4-bit

Text generation · Goekdeniz-Guelmez ↓ 192 · ♥ 0

Params

4.0B

Weights

≈ 2.3 GB

Mac memory

8 GB+

updated 2026-03-14

gemma-2b-coder

mlx-community/gemma-2b-coder

Text generation ↓ 192 · ♥ 0

Params

2.5B

Weights

≈ 9.0 GB

Mac memory

16 GB+

updated 2024-02-27

whisper-small-4bit

from openai/whisper-small

4-bit

Speech recognition · OpenAI · gpt-oss ↓ 192 · ♥ 0

Params

241M

Weights

≈ 139 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-12-15

gemma-4-31b-it-nvfp4

from google/gemma-4-31B-it

4-bit

Vision + text · Google · Gemma ↓ 191 · ♥ 8

Params

31B

Weights

≈ 18.4 GB

Mac memory

24 GB+

gemma · updated 2026-07-06

Laguna-S-2.1-oQ6e

from poolside/Laguna-S-2.1

6-bit

Text generation · poolside ↓ 191 · ♥ 7

Params

118B

Weights

≈ 95.6 GB

Mac memory

128 GB+

openmdw-1.1 · updated 2026-07-24

Llama-3.3-Swallow-70B-Instruct-v0.4-8bit

from tokyotech-llm/Llama-3.3-Swallow-70B-Instruct-v0.4

8-bit

Text generation · tokyotech-llm ↓ 191 · ♥ 1

Params

71B

Weights

≈ 75.0 GB

Mac memory

96 GB+

llama3.3 · updated 2025-03-10

LFM2.5-24B-A2B-Preview-8bit

from lq-preview/LFM2.5-24B-A2B-Preview

8-bit

Text generation · lq-preview ↓ 191 · ♥ 0

Params

24B

Weights

≈ 25.5 GB

Mac memory

32 GB+

lfm1.0 · updated 2026-10-13

Nemotron-3-Embed-1B-BF16-4bit

from nvidia/Nemotron-3-Embed-1B-BF16

4-bit

Sentence similarity · NVIDIA ↓ 191 · ♥ 0

Params

1.1B

Weights

≈ 642 MB

Mac memory

8 GB+

openmdw-1.1 · updated 2026-08-04

Qwen3-8B-3bit

from Qwen/Qwen3-8B

3-bit

Text generation · Qwen ↓ 191 · ♥ 0

Params

8.2B

Weights

≈ 3.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-28

Moonlight-16B-A3B-Instruct-4-bit

from moonshotai/Moonlight-16B-A3B-Instruct

4-bit

Text generation · Moonshot · Kimi ↓ 190 · ♥ 4

Params

16B

Weights

≈ 9.0 GB

Mac memory

16 GB+

mit · updated 2025-02-28

Llama-3.1-70B-Japanese-Instruct-2407-8bit

mlx-community/Llama-3.1-70B-Japanese-Instruct-2407-8bit

8-bit

Text generation ↓ 190 · ♥ 1

Params

71B

Weights

≈ 75.0 GB

Mac memory

96 GB+

llama3.1 · updated 2024-07-26

Ministral-3-3B-Base-2512-4bit

from mistralai/Ministral-3-3B-Base-2512

4-bit

Vision + text · Mistral ↓ 190 · ♥ 1

Params

3.8B

Weights

≈ 2.8 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-07-18

openai-privacy-filter-nvfp4

from openai/privacy-filter

Token classification · OpenAI · gpt-oss ↓ 190 · ♥ 1

Params

1.4B

Weights

≈ 5.6 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-04-23

Laguna-XS-2.1-8bit

from poolside/Laguna-XS-2.1

8-bit

Text generation · poolside ↓ 189 · ♥ 2

Params

33B

Weights

≈ 35.5 GB

Mac memory

48 GB+

openmdw-1.1 · updated 2026-07-03

Josiefied-Qwen2.5-Coder-7B-Instruct-abliterated-v1

from Goekdeniz-Guelmez/Josiefied-Qwen2.5-Coder-7B-Instruct-abliterated-v1

Text generation · Goekdeniz-Guelmez ↓ 189 · ♥ 1

Params

7.6B

Weights

≈ 15.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-02-16

LightOnOCR-3-1B-mlx-4bit

from lightonai/LightOnOCR-3-1B

4-bit

Vision + text · lightonai ↓ 189 · ♥ 0

Params

1.0B

Weights

≈ 1.2 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-10-17

DeepSeek-R1-Distill-Qwen-14B

from deepseek-ai/DeepSeek-R1-Distill-Qwen-14B

Text generation · DeepSeek ↓ 188 · ♥ 4

Params

15B

Weights

≈ 29.5 GB

Mac memory

48 GB+

updated 2025-02-26

YOLO26x-OptiQ-6bit

from Ultralytics/YOLO26

6-bit

Object detection · Ultralytics ↓ 188 · ♥ 4

Params

—

Weights

—

Mac memory

—

agpl-3.0 · updated 2026-09-28

Unlimited-OCR-bf16

from baidu/Unlimited-OCR

bf16

Vision + text · baidu ↓ 188 · ♥ 2

Params

3.3B

Weights

≈ 6.7 GB

Mac memory

16 GB+

mit · updated 2026-07-31

starcoder2-7b-4bit

mlx-community/starcoder2-7b-4bit

4-bit

Text generation ↓ 188 · ♥ 2

Params

7.2B

Weights

≈ 4.4 GB

Mac memory

8 GB+

bigcode-openrail-m · updated 2024-03-03

Qwen3.5-0.8B-MLX-bf16

from Qwen/Qwen3.5-0.8B

bf16

Uncategorised · Qwen ↓ 188 · ♥ 1

Params

853M

Weights

≈ 1.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-02

Qwopus3.8-27B-Flash-V2-8bit

from Jackrong/Qwopus3.8-27B-Flash-V2

8-bit

Vision + text · Jackrong ↓ 188 · ♥ 0

Params

27B

Weights

≈ 29.5 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-09-22

Falcon-OCR-bf16

from tiiuae/Falcon-OCR

bf16

Vision + text · TII · Falcon ↓ 187 · ♥ 4

Params

270M

Weights

≈ 540 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-12

Fara1.5-27B-OptiQ-4bit

from microsoft/Fara1.5-27B

4-bit

Vision + text · Microsoft · Phi ↓ 187 · ♥ 2

Params

27B

Weights

≈ 16.1 GB

Mac memory

24 GB+

mit · updated 2026-10-18

Qwen2.5-Math-72B-Instruct-4bit

from Qwen/Qwen2.5-Math-72B-Instruct

4-bit

Text generation · Qwen ↓ 187 · ♥ 1

Params

73B

Weights

≈ 40.9 GB

Mac memory

48 GB+

qwen · updated 2024-09-18

Ming-3.0-asr-tiny-4bit

mlx-community/Ming-3.0-asr-tiny-4bit

4-bit

Uncategorised ↓ 187 · ♥ 0

Params

8.5B

Weights

≈ 5.7 GB

Mac memory

16 GB+

updated 2026-10-19

Tess-4-27B-OptiQ-4bit

from migtissera/Tess-4-27B

4-bit

Vision + text · migtissera ↓ 187 · ♥ 0

Params

27B

Weights

≈ 16.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-10-30

LocateAnything-3B-8bit

from nvidia/LocateAnything-3B

8-bit

Vision + text · NVIDIA ↓ 186 · ♥ 12

Params

3.5B

Weights

≈ 4.1 GB

Mac memory

8 GB+

nvidia-license · updated 2026-05-29

gemma-4-31B-it-qat-mxfp8

mlx-community/gemma-4-31B-it-qat-mxfp8

MXFP8

Vision + text ↓ 186 · ♥ 3

Params

31B

Weights

≈ 33.8 GB

Mac memory

48 GB+

updated 2026-06-05

DeepSeek-V4-Pro-8bit

mlx-community/DeepSeek-V4-Pro-8bit

8-bit

Text generation ↓ 186 · ♥ 2

Params

1.6T

Weights

≈ 1672 GB

Mac memory

> 512 GB

updated 2026-05-23

AI21-Jamba-Reasoning-3B-4bit

from ai21labs/AI21-Jamba-Reasoning-3B

4-bit

Text generation · AI21 · Jamba ↓ 186 · ♥ 1

Params

3.0B

Weights

≈ 1.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-14

gte-Qwen2-1.5B-instruct-4bit-dwq

from Alibaba-NLP/gte-Qwen2-1.5B-instruct

4-bit DWQ

Text generation · Alibaba-NLP ↓ 186 · ♥ 1

Params

1.8B

Weights

≈ 999 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-05-17

openai-privacy-filter-mxfp4

from openai/privacy-filter

MXFP4

Token classification · OpenAI · gpt-oss ↓ 186 · ♥ 1

Params

1.4B

Weights

≈ 790 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-04-23

AuK-bf16

from tencent/AuK

bf16

Text to speech · tencent ↓ 186 · ♥ 0

Params

—

Weights

—

Mac memory

—

mit · updated 2026-11-02

Nemotron-Mini-4B-Instruct-4bit-mlx

from nvidia/Nemotron-Mini-4B-Instruct

4-bit

Uncategorised · NVIDIA ↓ 186 · ♥ 0

Params

4.2B

Weights

≈ 2.4 GB

Mac memory

8 GB+

nvidia-open-model-license · updated 2026-05-05

bigcode-starcoder2-15b-fp32

from bigcode/starcoder2-15b

fp32

Text generation · BigCode ↓ 186 · ♥ 0

Params

16B

Weights

≈ 63.8 GB

Mac memory

96 GB+

bigcode-openrail-m · updated 2025-02-16

Llama-4-Scout-17B-16E-Instruct-6bit

from meta-llama/Llama-4-Scout-17B-16E

6-bit

Vision + text · Meta · Llama ↓ 185 · ♥ 5

Params

—

Weights

—

Mac memory

—

llama4 · updated 2025-05-03

Mellum2-12B-A2.5B-Instruct-mxfp4

from JetBrains/Mellum2-12B-A2.5B-Instruct

MXFP4

Text generation · JetBrains ↓ 185 · ♥ 4

Params

12B

Weights

≈ 6.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-08-11

Nex-N2.5-mini-OptiQ-4bit

from nex-agi/Nex-N2.5-mini

4-bit

Vision + text · nex-agi ↓ 185 · ♥ 2

Params

35B

Weights

≈ 20.4 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-09-12

Phi-Line_14B-4bit

from SicariusSicariiStuff/Phi-Line_14B

4-bit

Uncategorised · SicariusSicariiStuff ↓ 185 · ♥ 2

Params

15B

Weights

≈ 8.2 GB

Mac memory

16 GB+

mit · updated 2025-02-21

Qwen3-30B-A3B-3bit

from Qwen/Qwen3-30B-A3B

3-bit

Text generation · Qwen ↓ 185 · ♥ 2

Params

31B

Weights

≈ 13.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-07-01

AuK-Flash-bf16

from tencent/AuK-Flash

bf16

Text to speech · tencent ↓ 185 · ♥ 0

Params

—

Weights

—

Mac memory

—

mit · updated 2026-11-02

Qwen3-4B-Instruct-2507-nvfp4

from Qwen/Qwen3-4B-Instruct-2507

4-bit

Text generation · Qwen ↓ 185 · ♥ 0

Params

4.0B

Weights

≈ 2.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-02-08

LFM2-350M-4bit

from LiquidAI/LFM2-350M

4-bit

Text generation · LiquidAI ↓ 184 · ♥ 4

Params

354M

Weights

≈ 199 MB

Mac memory

8 GB+

lfm1.0 · updated 2025-07-11

c4ai-command-r7b-12-2024-bf16

from CohereLabs/c4ai-command-r7b-12-2024

bf16

Text generation · Cohere ↓ 184 · ♥ 4

Params

8.0B

Weights

≈ 16.1 GB

Mac memory

24 GB+

cc-by-nc-4.0 · updated 2024-12-14

Qwen3-Coder-Next-mxfp4

from Qwen/Qwen3-Coder-Next

MXFP4

Text generation · Qwen ↓ 184 · ♥ 2

Params

80B

Weights

≈ 44.8 GB

Mac memory

64 GB+

apache-2.0 · updated 2026-05-06

Chatterbox-Turbo-TTS-8bit

from ResembleAI/chatterbox-turbo

8-bit

Text to speech · ResembleAI ↓ 183 · ♥ 2

Params

623M

Weights

≈ 962 MB

Mac memory

8 GB+

updated 2025-12-22

GLM-4.7-Flash-abliterated-mxfp8

from huihui-ai/Huihui-GLM-4.7-Flash-abliterated

MXFP8

Text generation · huihui-ai ↓ 183 · ♥ 2

Params

30B

Weights

≈ 31.8 GB

Mac memory

48 GB+

mit · updated 2026-03-07

gemma-4-26B-A4B-it-qat-6bit

mlx-community/gemma-4-26B-A4B-it-qat-6bit

6-bit

Vision + text ↓ 183 · ♥ 2

Params

26B

Weights

≈ 21.6 GB

Mac memory

32 GB+

updated 2026-06-05

dots.ocr-8bit

mlx-community/dots.ocr-8bit

8-bit

Vision + text ↓ 183 · ♥ 0

Params

3.0B

Weights

≈ 4.4 GB

Mac memory

8 GB+

mit · updated 2026-02-17