Apple MLX models

NeoHorse-1-4B-4bit

from TokenRhythm/NeoHorse-1-4B

4-bit

Text generation · TokenRhythm ↓ 138 · ♥ 3

Params

4.2B

Weights

≈ 2.4 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-09-14

moge-3-vitl-mlx-fp32

mlx-community/moge-3-vitl-mlx-fp32

fp32

Depth estimation ↓ 138 · ♥ 1

Params

370M

Weights

≈ 1.5 GB

Mac memory

8 GB+

mit · updated 2026-09-02

K2-Horizon-3.7B-8bit

from IFM/K2-Horizon-3.7B

8-bit

Text generation · IFM ↓ 138 · ♥ 0

Params

5.1B

Weights

≈ 5.4 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-09-30

Qwen3-4B-Thinking-2507-8bit

from Qwen/Qwen3-4B-Thinking-2507

8-bit

Text generation · Qwen ↓ 138 · ♥ 0

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-08-06

DeepSeek-R1-0528-Qwen3-8B-4bit-DWQ

from deepseek-ai/DeepSeek-R1-0528-Qwen3-8B

4-bit DWQ

Text generation · DeepSeek ↓ 137 · ♥ 8

Params

8.2B

Weights

≈ 4.6 GB

Mac memory

8 GB+

mit · updated 2025-05-29

Laguna-S-2.1-OptiQ-2bit

from poolside/Laguna-S-2.1

2-bit

Text generation · poolside ↓ 137 · ♥ 3

Params

118B

Weights

≈ 36.8 GB

Mac memory

48 GB+

openmdw-1.1 · updated 2026-09-15

XYZ-Aquila-mini-OptiQ-4bit-REAP-18B

from mlx-community/XYZ-Aquila-mini-OptiQ-4bit

4-bit

Text generation ↓ 137 · ♥ 2

Params

19B

Weights

≈ 11.3 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-09-15

LightOnOCR-2-1B-4bit

mlx-community/LightOnOCR-2-1B-4bit

4-bit

Vision + text ↓ 137 · ♥ 1

Params

1.0B

Weights

≈ 1.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-02-06

gemma-3n-E2B-it-text-4bit-dwq

from google/gemma-3n-E2B-it

4-bit DWQ

Text generation · Google · Gemma ↓ 137 · ♥ 1

Params

4.5B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2025-07-27

Qwen3-30B-A3B-4bit-DWQ-0508

from Qwen/Qwen3-30B-A3B

4-bit DWQ

Text generation · Qwen ↓ 136 · ♥ 14

Params

31B

Weights

≈ 17.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-05-08

gemma-2-2b-it

mlx-community/gemma-2-2b-it

Text generation ↓ 136 · ♥ 8

Params

2.6B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2024-11-06

codegemma-7b-it-8bit

mlx-community/codegemma-7b-it-8bit

8-bit

Text generation ↓ 136 · ♥ 6

Params

8.5B

Weights

≈ 9.8 GB

Mac memory

16 GB+

gemma · updated 2024-04-09

Kimi-Linear-48B-A3B-Instruct-6bit

from moonshotai/Kimi-Linear-48B-A3B-Instruct

6-bit

Text generation · Moonshot · Kimi ↓ 136 · ♥ 3

Params

49B

Weights

≈ 39.9 GB

Mac memory

48 GB+

mit · updated 2026-01-22

dolphin-2.9.4-llama3.1-8b-8bit

from dphn/dolphin-2.9.4-llama3.1-8b

8-bit

Uncategorised · dphn ↓ 136 · ♥ 3

Params

8.0B

Weights

≈ 8.5 GB

Mac memory

16 GB+

llama3.1 · updated 2024-10-21

Qwen3.5-9B-MLX-bf16

from Qwen/Qwen3.5-9B

bf16

Uncategorised · Qwen ↓ 136 · ♥ 2

Params

9.4B

Weights

≈ 18.8 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-03-02

deepseek-vl-7b-chat-4bit

mlx-community/deepseek-vl-7b-chat-4bit

4-bit

Vision + text ↓ 136 · ♥ 2

Params

7.3B

Weights

≈ 4.2 GB

Mac memory

8 GB+

deepseek · updated 2024-12-26

gemma-2-9b-4bit

mlx-community/gemma-2-9b-4bit

4-bit

Text generation ↓ 136 · ♥ 2

Params

9.2B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2024-06-27

Meta-Llama-3.1-8B-Instruct-abliterated-bfloat16

from meta-llama/Llama-3.1-8B-Instruct

Text generation · Meta · Llama ↓ 136 · ♥ 1

Params

8.0B

Weights

≈ 16.1 GB

Mac memory

24 GB+

llama3.1 · updated 2024-08-03

Phi-4-mini-instruct-mlx-6Bit

from microsoft/Phi-4-mini-instruct

6-bit

Text generation · Microsoft · Phi ↓ 136 · ♥ 1

Params

3.8B

Weights

≈ 3.1 GB

Mac memory

8 GB+

mit · updated 2026-07-27

gemma-4-31B-it-qat-6bit

mlx-community/gemma-4-31B-it-qat-6bit

6-bit

Vision + text ↓ 136 · ♥ 1

Params

31B

Weights

≈ 26.1 GB

Mac memory

32 GB+

updated 2026-06-05

quantized-gemma-2b

mlx-community/quantized-gemma-2b

Text generation ↓ 135 · ♥ 8

Params

2.5B

Weights

≈ 9.0 GB

Mac memory

16 GB+

gemma-terms-of-use · updated 2024-02-21

VibeVoice-Realtime-0.5B-4bit

from Qwen/Qwen2.5-0.5B

4-bit

Text to speech · Qwen ↓ 135 · ♥ 7

Params

1.0B

Weights

≈ 633 MB

Mac memory

8 GB+

mit · updated 2025-12-15

gemma-4-26b-a4b-it-mxfp8

from google/gemma-4-26B-A4B-it

MXFP8

Vision + text · Google · Gemma ↓ 135 · ♥ 4

Params

26B

Weights

≈ 28.0 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-07-05

CodeLlama-7b-Instruct-hf-4bit-MLX

mlx-community/CodeLlama-7b-Instruct-hf-4bit-MLX

4-bit

Text generation ↓ 135 · ♥ 3

Params

—

Weights

—

Mac memory

—

llama2 · updated 2024-01-30

Qwen2.5-VL-3B-Instruct-3bit

from Qwen/Qwen2.5-VL-3B-Instruct

3-bit

Vision + text · Qwen ↓ 135 · ♥ 3

Params

3.8B

Weights

≈ 2.7 GB

Mac memory

8 GB+

updated 2025-02-25

Hermes-3-Llama-3.2-3B-4bit

from NousResearch/Hermes-3-Llama-3.2-3B

4-bit

Text generation · NousResearch ↓ 135 · ♥ 1

Params

3.2B

Weights

≈ 1.8 GB

Mac memory

8 GB+

llama3 · updated 2024-12-11

Agents-A1-OptiQ-4bit-REAP-19B

from mlx-community/Agents-A1-OptiQ-4bit

4-bit

Text generation ↓ 135 · ♥ 0

Params

19B

Weights

≈ 11.3 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-09-15

Qwen3.5-4B-mixed_2_6

mlx-community/Qwen3.5-4B-mixed_2_6

4-bit

Uncategorised ↓ 135 · ♥ 0

Params

857M

Weights

≈ 1.2 GB

Mac memory

8 GB+

updated 2026-03-02

quantized-gemma-2b-it

mlx-community/quantized-gemma-2b-it

Text generation ↓ 134 · ♥ 10

Params

2.5B

Weights

≈ 9.0 GB

Mac memory

16 GB+

gemma-terms-of-use · updated 2024-02-22

GLM-4.6V-4bit

mlx-community/GLM-4.6V-4bit

4-bit

Vision + text ↓ 134 · ♥ 5

Params

—

Weights

—

Mac memory

—

mit · updated 2025-12-08

DeepSeek-R1-Distill-Qwen-32B-3bit

from deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

3-bit

Uncategorised · DeepSeek ↓ 134 · ♥ 4

Params

33B

Weights

≈ 14.3 GB

Mac memory

24 GB+

updated 2025-02-26

YandexGPT-5-Lite-8B-pretrain-Q8-mlx

from yandex/YandexGPT-5-Lite-8B-pretrain

8-bit

Uncategorised · yandex ↓ 134 · ♥ 4

Params

8.0B

Weights

≈ 8.5 GB

Mac memory

16 GB+

yandexgpt-5-lite-8b-pretrain · updated 2025-02-26

DeepSeek-R1-0528-Qwen3-8B-8bit

from deepseek-ai/deepseek-r1-0528-Qwen3-8B

8-bit

Text generation · DeepSeek ↓ 134 · ♥ 3

Params

8.2B

Weights

≈ 8.7 GB

Mac memory

16 GB+

mit · updated 2025-05-29

Ministral-3-14B-Reasoning-2512-bf16

from mistralai/Ministral-3-14B-Base-2512

bf16

Uncategorised · Mistral ↓ 134 · ♥ 1

Params

14B

Weights

≈ 27.9 GB

Mac memory

48 GB+

apache-2.0 · updated 2025-12-04

Llama-3.1-Swallow-8B-Instruct-v0.5-4bit

from tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.5

4-bit

Text generation · tokyotech-llm ↓ 134 · ♥ 0

Params

8.0B

Weights

≈ 4.5 GB

Mac memory

8 GB+

llama3.3 · updated 2025-06-25

Qwen3-Omni-30B-A3B-Instruct-6bit

mlx-community/Qwen3-Omni-30B-A3B-Instruct-6bit

6-bit

Any to any ↓ 134 · ♥ 0

Params

35B

Weights

≈ 30.3 GB

Mac memory

48 GB+

apache-2.0 · updated 2025-12-24

Qwen3.5-2B-MLX-bf16

from Qwen/Qwen3.5-2B

bf16

Uncategorised · Qwen ↓ 134 · ♥ 0

Params

2.2B

Weights

≈ 4.4 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-02

Qwen3.5-4B-mixed_4_6

mlx-community/Qwen3.5-4B-mixed_4_6

4-bit

Uncategorised ↓ 134 · ♥ 0

Params

1.1B

Weights

≈ 1.3 GB

Mac memory

8 GB+

updated 2026-03-02

deepseek-coder-6.7b-base-4bit-mlx

mlx-community/deepseek-coder-6.7b-base-4bit-mlx

4-bit

Uncategorised ↓ 134 · ♥ 0

Params

—

Weights

—

Mac memory

—

deepseek-license · updated 2024-01-14

CodeLlama-70b-Python-hf-4bit-MLX

mlx-community/CodeLlama-70b-Python-hf-4bit-MLX

4-bit

Text generation ↓ 133 · ♥ 11

Params

—

Weights

—

Mac memory

—

llama2 · updated 2024-01-30

functiongemma-270m-it-bf16

from google/functiongemma-270m-it

bf16

Text generation · Google · Gemma ↓ 133 · ♥ 7

Params

268M

Weights

≈ 536 MB

Mac memory

8 GB+

gemma · updated 2025-12-18

SoulX-Singer-fp32

from Soul-AILab/SoulX-Singer

fp32

Text to audio · Soul-AILab ↓ 133 · ♥ 3

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-05-31

Huihui-gemma-3n-E4B-it-abliterated-lm-8bit

from huihui-ai/Huihui-gemma-3n-E4B-it-abliterated

8-bit

Text generation · huihui-ai ↓ 133 · ♥ 1

Params

6.9B

Weights

≈ 7.3 GB

Mac memory

16 GB+

gemma · updated 2025-09-25

NVIDIA-Nemotron-3-Nano-4B-6bit

from nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16

6-bit

Text generation · NVIDIA ↓ 133 · ♥ 1

Params

4.0B

Weights

≈ 3.2 GB

Mac memory

8 GB+

nvidia-nemotron-open-model-license · updated 2026-03-20

d1a-e4b-it-8bit

from JohnP1/d1a-e4b-it

8-bit

Text classification · JohnP1 ↓ 133 · ♥ 0

Params

7.5B

Weights

≈ 7.9 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-10-25

encodec-32khz-float32

mlx-community/encodec-32khz-float32

Uncategorised ↓ 133 · ♥ 0

Params

58M

Weights

≈ 232 MB

Mac memory

8 GB+

other · updated 2024-09-18

granite-4.0-1b-speech-8bit

from ibm-granite/granite-4.0-1b-base

8-bit

Uncategorised · IBM · Granite ↓ 133 · ♥ 0

Params

2.3B

Weights

≈ 2.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-11

nemotron-labs-unified-asr-0.6b-8bit

from nvidia/nemotron-labs-unified-asr-0.6b

8-bit

Speech recognition · NVIDIA ↓ 133 · ♥ 0

Params

627M

Weights

≈ 744 MB

Mac memory

8 GB+

openmdw-1.1 · updated 2026-11-04

phi-4-3bit

from microsoft/phi-4

3-bit

Text generation · Microsoft · Phi ↓ 133 · ♥ 0

Params

15B

Weights

≈ 6.4 GB

Mac memory

16 GB+

mit · updated 2025-01-12

typhoon-ocr1.5-2b-8bit

from typhoon-ai/typhoon-ocr1.5-2b

8-bit

Vision + text · typhoon-ai ↓ 133 · ♥ 0

Params

2.1B

Weights

≈ 2.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-06-26

QwQ-32B-4bit

from Qwen/QwQ-32B

4-bit

Text generation · Qwen ↓ 132 · ♥ 38

Params

33B

Weights

≈ 18.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-03-05

Mage-VL-OptiQ-4bit

from microsoft/Mage-VL

4-bit

Vision + text · Microsoft · Phi ↓ 132 · ♥ 3

Params

4.4B

Weights

≈ 2.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-09-15

deepseek-ai-DeepSeek-V4-Flash-6bit

from deepseek-ai/DeepSeek-V4-Flash

6-bit

Text generation · DeepSeek ↓ 132 · ♥ 2

Params

284B

Weights

≈ 231 GB

Mac memory

512 GB+

mit · updated 2026-04-24

ResembleAI-Dramabox

mlx-community/ResembleAI-Dramabox

Uncategorised ↓ 132 · ♥ 1

Params

—

Weights

—

Mac memory

—

ltx-2-community · updated 2026-05-14

Seed-Coder-8B-Instruct-6bit

from ByteDance-Seed/Seed-Coder-8B-Instruct

6-bit

Text generation · ByteDance-Seed ↓ 132 · ♥ 1

Params

8.3B

Weights

≈ 6.7 GB

Mac memory

16 GB+

mit · updated 2025-05-20

TheDrummer_Big-Tiger-Gemma-27B-v1_4bit

from TheDrummer/Big-Tiger-Gemma-27B-v1

4-bit

Uncategorised · TheDrummer ↓ 132 · ♥ 1

Params

27B

Weights

≈ 15.3 GB

Mac memory

24 GB+

updated 2024-10-09

SmolLM3-3B-8bit

from HuggingFaceTB/SmolLM3-3B

8-bit

Text generation · Hugging Face ↓ 131 · ♥ 9

Params

3.1B

Weights

≈ 3.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-07-08

Llama-3.1-Nemotron-70B-Instruct-HF

from nvidia/Llama-3.1-Nemotron-70B-Instruct-HF

Text generation · NVIDIA ↓ 131 · ♥ 3

Params

71B

Weights

≈ 141 GB

Mac memory

192 GB+

llama3.1 · updated 2024-10-16

Mistral-7B-Instruct-v0.3-8bit

mlx-community/Mistral-7B-Instruct-v0.3-8bit

8-bit

Uncategorised ↓ 131 · ♥ 3

Params

7.2B

Weights

≈ 7.7 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-05-22

DeepSeek-OCR-bf16

mlx-community/DeepSeek-OCR-bf16

bf16

Vision + text ↓ 131 · ♥ 2

Params

3.3B

Weights

≈ 6.7 GB

Mac memory

16 GB+

mit · updated 2026-01-28