Apple MLX models

Qwen_QwQ-32B-Preview_MLX-4bit

from Qwen/QwQ-32B-Preview

4-bit

Text generation · Qwen ↓ 56 · ♥ 1

Params

33B

Weights

≈ 18.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2024-11-28

Qwopus3.6-27B-Coder-oQ4-mtp

mlx-community/Qwopus3.6-27B-Coder-oQ4-mtp

4-bit

Uncategorised ↓ 56 · ♥ 1

Params

28B

Weights

≈ 16.4 GB

Mac memory

24 GB+

updated 2026-09-16

SenseNova-U1.5-8B-MoT-8step-8bit

from sensenova/SenseNova-U1.5-8B-MoT

8-bit

Any to any · sensenova ↓ 56 · ♥ 1

Params

18B

Weights

≈ 19.9 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-10-11

defog-llama-3-sqlcoder-8b

mlx-community/defog-llama-3-sqlcoder-8b

Text generation ↓ 56 · ♥ 1

Params

8.0B

Weights

≈ 16.1 GB

Mac memory

24 GB+

cc-by-sa-4.0 · updated 2024-05-10

gemma-3-12b-it-qat-3bit

from OpenGVLab/InternVL3-1B-Instruct

3-bit

Vision + text · OpenGVLab ↓ 56 · ♥ 1

Params

—

Weights

—

Mac memory

—

qwen · updated 2025-04-21

gemma-4-26b-a4b-5bit

from google/gemma-4-26b-a4b

5-bit

Vision + text · Google · Gemma ↓ 56 · ♥ 1

Params

26B

Weights

≈ 18.5 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-04-03

granite-34b-code-instruct-4bit

from ibm-granite/granite-34b-code-base-8k

4-bit

Text generation · IBM · Granite ↓ 56 · ♥ 1

Params

34B

Weights

≈ 19.0 GB

Mac memory

24 GB+

apache-2.0 · updated 2024-05-14

llava-v1.6-mistral-7b-8bit

mlx-community/llava-v1.6-mistral-7b-8bit

8-bit

Vision + text ↓ 56 · ♥ 1

Params

7.6B

Weights

≈ 8.0 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-01-11

DeepSeek-R1-Distill-Qwen-14B-bf16

from deepseek-ai/DeepSeek-R1-Distill-Qwen-14B

bf16

Uncategorised · DeepSeek ↓ 56 · ♥ 0

Params

15B

Weights

≈ 29.5 GB

Mac memory

48 GB+

updated 2025-02-26

Falcon-H1-Tiny-Coder-90M-bf16

from tiiuae/Falcon-H1-Tiny-Coder-90M

bf16

Text generation · TII · Falcon ↓ 56 · ♥ 0

Params

91M

Weights

≈ 182 MB

Mac memory

8 GB+

falcon-llm-license · updated 2026-01-28

GLM-4-32B-Base-0414-6bit

from zai-org/GLM-4-32B-Base-0414

6-bit

Text generation · zai-org ↓ 56 · ♥ 0

Params

33B

Weights

≈ 26.5 GB

Mac memory

32 GB+

mit · updated 2025-04-21

InternVL3-9B-4bit

from OpenGVLab/InternVL3-1B-Instruct

4-bit

Vision + text · OpenGVLab ↓ 56 · ♥ 0

Params

7.9B

Weights

≈ 4.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-04-30

LongCat-AudioDiT-1B-8bit

mlx-community/LongCat-AudioDiT-1B-8bit

8-bit

Text to speech ↓ 56 · ♥ 0

Params

1.4B

Weights

≈ 2.0 GB

Mac memory

8 GB+

updated 2026-03-31

Ministral-3-14B-Reasoning-2512-5bit

from mistralai/Ministral-3-14B-Base-2512

5-bit

Uncategorised · Mistral ↓ 56 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-12-04

Ministral-3-8B-Reasoning-2512-6bit

from mistralai/Ministral-3-8B-Base-2512

6-bit

Uncategorised · Mistral ↓ 56 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-12-03

Mistral-7B-v0.1-4bit-fused

mlx-community/Mistral-7B-v0.1-4bit-fused

4-bit

Text generation ↓ 56 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2024-01-11

Molmo-7B-D-0924-3bit

from Qwen/Qwen2-7B

3-bit

Vision + text · Qwen ↓ 56 · ♥ 0

Params

8.0B

Weights

≈ 4.4 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-12-27

OuteTTS-1.0-0.6B-fp16

mlx-community/OuteTTS-1.0-0.6B-fp16

fp16

Text to speech ↓ 56 · ♥ 0

Params

602M

Weights

≈ 1.2 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-05-19

Qwen2.5-0.5B-8bit

mlx-community/Qwen2.5-0.5B-8bit

8-bit

Text generation ↓ 56 · ♥ 0

Params

494M

Weights

≈ 525 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

Qwen2.5-7B-bf16

mlx-community/Qwen2.5-7B-bf16

bf16

Text generation ↓ 56 · ♥ 0

Params

7.6B

Weights

≈ 15.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2024-09-18

Seed-OSS-36B-Instruct-8bit

from ByteDance-Seed/Seed-OSS-36B-Instruct

8-bit

Text generation · ByteDance-Seed ↓ 56 · ♥ 0

Params

36B

Weights

≈ 38.4 GB

Mac memory

48 GB+

apache-2.0 · updated 2025-09-03

SmolVLM-500M-Instruct-8bit

from HuggingFaceTB/SmolLM2-360M-Instruct

8-bit

Vision + text · Hugging Face ↓ 56 · ♥ 0

Params

507M

Weights

≈ 540 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-01-23

codegemma-7b-4bit

mlx-community/codegemma-7b-4bit

4-bit

Text generation ↓ 56 · ♥ 0

Params

8.5B

Weights

≈ 5.9 GB

Mac memory

16 GB+

gemma · updated 2024-04-09

gemma-3n-E2B-it-5bit

from google/gemma-3n-E4B-it

5-bit

Vision + text · Google · Gemma ↓ 56 · ♥ 0

Params

5.4B

Weights

≈ 5.0 GB

Mac memory

8 GB+

gemma · updated 2025-07-12

gemma-4-12B-it-qat-assistant-5bit

from google/gemma-4-12B-it-qat-q4_0-unquantized-assistant

5-bit

Text generation · Google · Gemma ↓ 56 · ♥ 0

Params

423M

Weights

≈ 291 MB

Mac memory

8 GB+

gemma · updated 2026-06-05

glm-4-9b-chat-1m-8bit

from zai-org/glm-4-9b-chat-1m-hf

8-bit

Text generation · zai-org ↓ 56 · ♥ 0

Params

9.5B

Weights

≈ 10.1 GB

Mac memory

16 GB+

glm-4 · updated 2025-09-14

llm-jp-3-8x1.8b-instruct3

from llm-jp/llm-jp-3-8x1.8b-instruct3

Text generation · llm-jp ↓ 56 · ♥ 0

Params

9.3B

Weights

≈ 18.5 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-03-27

translategemma-12b-it-mlx-mxfp4

mlx-community/translategemma-12b-it-mlx-mxfp4

MXFP4

Vision + text ↓ 56 · ♥ 0

Params

13B

Weights

≈ 8.0 GB

Mac memory

16 GB+

gemma · updated 2026-03-12

whisper-base-khmer-mlx-fp32

from openai-whisper-base

fp32

Speech recognition ↓ 56 · ♥ 0

Params

72M

Weights

≈ 287 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-25

whisper-tiny-khmer-mlx-fp16

from openai-whisper-tiny

fp16

Speech recognition ↓ 56 · ♥ 0

Params

37M

Weights

≈ 74 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-25

zephyr-7b-gemma-v0.1-4bit

from HuggingFaceH4/zephyr-7b-gemma-sft-v0.1

4-bit

Text generation · HuggingFaceH4 ↓ 56 · ♥ 0

Params

2.8B

Weights

≈ 1.8 GB

Mac memory

8 GB+

gemma-terms-of-use · updated 2024-03-02

QwQ-32B-Preview-bf16

from Qwen/QwQ-32B-Preview

bf16

Text generation · Qwen ↓ 55 · ♥ 5

Params

33B

Weights

≈ 65.5 GB

Mac memory

96 GB+

apache-2.0 · updated 2024-11-27

Jan-v1-4B-8bit

from janhq/Jan-v1-4B

8-bit

Text generation · janhq ↓ 55 · ♥ 3

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-08-12

Yi-1.5-34B-Chat-8bit

mlx-community/Yi-1.5-34B-Chat-8bit

8-bit

Uncategorised ↓ 55 · ♥ 3

Params

34B

Weights

≈ 36.5 GB

Mac memory

48 GB+

apache-2.0 · updated 2024-05-13

gemma-2-2b-jpn-it-4bit

from google/gemma-2-2b-it

4-bit

Text generation · Google · Gemma ↓ 55 · ♥ 3

Params

2.6B

Weights

≈ 1.5 GB

Mac memory

8 GB+

gemma · updated 2024-10-03

DeepSeek-Prover-V2-7B-bf16

from deepseek-ai/DeepSeek-Prover-V2-7B

bf16

Text generation · DeepSeek ↓ 55 · ♥ 2

Params

6.9B

Weights

≈ 13.8 GB

Mac memory

24 GB+

updated 2025-06-02

Ling-2.6-flash-mlx-4bit

from inclusionAI/Ling-2.6-flash

4-bit

Text generation · inclusionAI ↓ 55 · ♥ 2

Params

104B

Weights

≈ 58.6 GB

Mac memory

96 GB+

mit · updated 2026-04-29

PaddleOCR-VL-4bit

from baidu/ERNIE-4.5-0.3B-Paddle

4-bit

Vision + text · baidu ↓ 55 · ♥ 2

Params

906M

Weights

≈ 703 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-19

ShowUI-2B-bf16-8bit

from Qwen/Qwen2-VL-2B-Instruct

8-bit

Uncategorised · Qwen ↓ 55 · ♥ 2

Params

2.2B

Weights

≈ 3.0 GB

Mac memory

8 GB+

mit · updated 2025-02-26

Ornith-1.0-9B-bf16

from deepreinforce-ai/Ornith-1.0-9B

bf16

Text generation · deepreinforce-ai ↓ 55 · ♥ 1

Params

9.4B

Weights

≈ 18.8 GB

Mac memory

24 GB+

mit · updated 2026-06-28

Qwen3-TTS-12Hz-0.6B-Base-5bit

mlx-community/Qwen3-TTS-12Hz-0.6B-Base-5bit

5-bit

Text to speech ↓ 55 · ♥ 1

Params

915M

Weights

≈ 1.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-25

Qwen3-VL-2B-Thinking-4bit

mlx-community/Qwen3-VL-2B-Thinking-4bit

4-bit

Vision + text ↓ 55 · ♥ 1

Params

2.1B

Weights

≈ 1.8 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-21

Spark-TTS-0.5B-4-6bit

mlx-community/Spark-TTS-0.5B-4-6bit

6-bit

Text to speech ↓ 55 · ♥ 1

Params

533M

Weights

≈ 434 MB

Mac memory

8 GB+

cc-by-nc-sa-4.0 · updated 2025-05-08

codegemma-1.1-7b-it-6bit

from google/codegemma-1.1-7b-it

6-bit

Text generation · Google · Gemma ↓ 55 · ♥ 1

Params

8.5B

Weights

≈ 6.9 GB

Mac memory

16 GB+

gemma · updated 2025-06-01

gemma-3-text-4b-pt-4bit

from mlx-community/gemma-3-4b-pt-bf16

4-bit

Text generation ↓ 55 · ♥ 1

Params

4.6B

Weights

≈ 2.6 GB

Mac memory

8 GB+

gemma · updated 2025-03-18

granite-4.1-3b-bf16

from ibm-granite/granite-4.1-3b

bf16

Text generation · IBM · Granite ↓ 55 · ♥ 1

Params

3.4B

Weights

≈ 6.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-04-30

AnimeGen-I2V-A14B-Lightning-int4

from Wan-AI/Wan2.2-I2V-A14B

Image to video · Wan-AI ↓ 55 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-07-14

Bernini-v2-int4

from ByteDance/Bernini-Diffusers-v2

Image to video · ByteDance ↓ 55 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-08-18

Llama-3.1-Swallow-8B-Instruct-v0.2

from tokyotech-llm/Llama-3.1-Swallow-8B-Instruct-v0.2

Text generation · tokyotech-llm ↓ 55 · ♥ 0

Params

8.0B

Weights

≈ 16.1 GB

Mac memory

24 GB+

llama3.1 · updated 2024-11-11

Mistral-Small-3.1-24B-Instruct-2503-3bit

from mistralai/Mistral-Small-3.1-24B-Base-2503

3-bit

Uncategorised · Mistral ↓ 55 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-03-19

MolmoPoint-8B-8bit

from Qwen/Qwen3-8B

8-bit

Vision + text · Qwen ↓ 55 · ♥ 0

Params

8.7B

Weights

≈ 10.7 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-03-21

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-mxfp4

from nvidia/Nemotron-3-Nano-Omni-30B-A3B-Reasoning-BF16

MXFP4

Vision + text · NVIDIA ↓ 55 · ♥ 0

Params

33B

Weights

≈ 19.6 GB

Mac memory

24 GB+

nvidia-open-model-agreement · updated 2026-04-29

OLMo-2-1124-13B-Instruct-8bit

from allenai/OLMo-2-1124-13B-Instruct

8-bit

Text generation · Ai2 · OLMo ↓ 55 · ♥ 0

Params

14B

Weights

≈ 14.6 GB

Mac memory

24 GB+

apache-2.0 · updated 2024-11-27

OLMoE-1B-7B-0125-Instruct-8bit

from allenai/OLMoE-1B-7B-0125-Instruct

8-bit

Text generation · Ai2 · OLMo ↓ 55 · ♥ 0

Params

6.9B

Weights

≈ 7.4 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-03-04

Qwen-AgentWorld-35B-A3B-oQ3.5

from Qwen/Qwen-AgentWorld-35B-A3B

3-bit

Text generation · Qwen ↓ 55 · ♥ 0

Params

35B

Weights

≈ 15.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-06-27

Qwen1.5-0.5B-Chat

mlx-community/Qwen1.5-0.5B-Chat

Text generation ↓ 55 · ♥ 0

Params

620M

Weights

≈ 1.2 GB

Mac memory

8 GB+

tongyi-qianwen-research · updated 2024-03-07

Qwen2.5-Math-7B-Instruct-8bit

from Qwen/Qwen2.5-Math-7B-Instruct

8-bit

Text generation · Qwen ↓ 55 · ♥ 0

Params

7.6B

Weights

≈ 8.1 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-03-03

Qwen3-TTS-12Hz-1.7B-Base-5bit

mlx-community/Qwen3-TTS-12Hz-1.7B-Base-5bit

5-bit

Text to speech ↓ 55 · ♥ 0

Params

1.9B

Weights

≈ 1.8 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-25

Qwen3-VL-32B-Instruct-6bit

mlx-community/Qwen3-VL-32B-Instruct-6bit

6-bit

Vision + text ↓ 55 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-21

Qwen3.5-397B-A17B-5bit

mlx-community/Qwen3.5-397B-A17B-5bit

5-bit

Vision + text ↓ 55 · ♥ 0

Params

397B

Weights

≈ 273 GB

Mac memory

512 GB+

apache-2.0 · updated 2026-02-19