Apple MLX models

c4ai-command-a-03-2025-bf16

from CohereLabs/c4ai-command-a-03-2025

bf16

Text generation · Cohere ↓ 66 · ♥ 1

Params

111B

Weights

≈ 222 GB

Mac memory

256 GB+

cc-by-nc-4.0 · updated 2025-03-18

3b-es_it-pretrain-research_release-6bit

from meta-llama/Llama-3.2-3B-Instruct

6-bit

Text to speech · Meta · Llama ↓ 66 · ♥ 0

Params

3.3B

Weights

≈ 2.7 GB

Mac memory

8 GB+

llama3.2 · updated 2025-04-09

DeepSeek-V4-Flash-nvfp4

mlx-community/DeepSeek-V4-Flash-nvfp4

4-bit

Text generation ↓ 66 · ♥ 0

Params

284B

Weights

≈ 160 GB

Mac memory

192 GB+

updated 2026-04-25

Phi-3.5-MoE-instruct-bf16

mlx-community/Phi-3.5-MoE-instruct-bf16

bf16

Text generation ↓ 66 · ♥ 0

Params

42B

Weights

≈ 83.7 GB

Mac memory

96 GB+

mit · updated 2024-08-24

Qwen-3-32B-Medical-Reasoning-4bit

from nicoboss/Qwen-3-32B-Medical-Reasoning

4-bit

Text generation · nicoboss ↓ 66 · ♥ 0

Params

33B

Weights

≈ 18.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-06-03

Qwen2.5-32B-Instruct-bf16

from Qwen/Qwen2.5-32B

bf16

Text generation · Qwen ↓ 66 · ♥ 0

Params

33B

Weights

≈ 65.5 GB

Mac memory

96 GB+

apache-2.0 · updated 2024-09-18

Qwen3-Coder-REAP-25B-A3B-mlx-8Bit

from cerebras/Qwen3-Coder-REAP-25B-A3B

8-bit

Text generation · cerebras ↓ 66 · ♥ 0

Params

25B

Weights

≈ 26.4 GB

Mac memory

32 GB+

apache-2.0 · updated 2025-11-05

Qwen3.5-35B-A3B-5bit

mlx-community/Qwen3.5-35B-A3B-5bit

5-bit

Vision + text ↓ 66 · ♥ 0

Params

35B

Weights

≈ 24.7 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-02-24

SmolLM-360M-4bit

mlx-community/SmolLM-360M-4bit

4-bit

Text generation ↓ 66 · ♥ 0

Params

362M

Weights

≈ 204 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-07-16

gemma-4-E2B-it-qat-5bit

mlx-community/gemma-4-E2B-it-qat-5bit

5-bit

Vision + text ↓ 66 · ♥ 0

Params

5.1B

Weights

≈ 4.1 GB

Mac memory

8 GB+

updated 2026-06-05

gemma2-9b-cpt-sahabatai-v1-instruct-4bit

from GoToCompany/gemma2-9b-cpt-sahabatai-v1-instruct

4-bit

Text generation · GoToCompany ↓ 66 · ♥ 0

Params

9.2B

Weights

≈ 5.2 GB

Mac memory

8 GB+

gemma · updated 2026-06-03

granite-4.0-h-350m-5bit

from ibm-granite/granite-4.0-h-350m

5-bit

Text generation · IBM · Granite ↓ 66 · ♥ 0

Params

340M

Weights

≈ 234 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-28

granite-8b-code-instruct-4bit

from ibm-granite/granite-8b-code-base-4k

4-bit

Text generation · IBM · Granite ↓ 66 · ♥ 0

Params

8.1B

Weights

≈ 4.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-05-06

idefics2-8b-chatty-4bit

mlx-community/idefics2-8b-chatty-4bit

4-bit

Vision + text ↓ 66 · ♥ 0

Params

8.4B

Weights

≈ 4.7 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-01-29

whisper-small-khmer-mlx-fp32

from openai-whisper-small

fp32

Speech recognition ↓ 66 · ♥ 0

Params

241M

Weights

≈ 962 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-10-25

whisper-tiny.en-mlx-q4

mlx-community/whisper-tiny.en-mlx-q4

4-bit

Uncategorised ↓ 66 · ♥ 0

Params

—

Weights

—

Mac memory

—

updated 2024-03-09

Ornith-1.0-35B-bf16

from deepreinforce-ai/Ornith-1.0-35B

bf16

Vision + text · deepreinforce-ai ↓ 65 · ♥ 8

Params

35B

Weights

≈ 70.2 GB

Mac memory

96 GB+

mit · updated 2026-06-27

Meta-Llama-3-8B-Instruct-8bit

mlx-community/Meta-Llama-3-8B-Instruct-8bit

8-bit

Text generation ↓ 65 · ♥ 5

Params

8.0B

Weights

≈ 9.0 GB

Mac memory

16 GB+

llama3 · updated 2024-04-19

Mamba-Codestral-7B-v0.1-8bit

from mistralai/Mamba-Codestral-7B-v0.1

8-bit

Uncategorised · Mistral ↓ 65 · ♥ 2

Params

2.1B

Weights

≈ 2.4 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-01-21

Phi-3-medium-128k-instruct-4bit

mlx-community/Phi-3-medium-128k-instruct-4bit

4-bit

Text generation ↓ 65 · ♥ 2

Params

14B

Weights

≈ 7.9 GB

Mac memory

16 GB+

mit · updated 2024-07-11

WizardLM-2-7B-4bit

mlx-community/WizardLM-2-7B-4bit

4-bit

Uncategorised ↓ 65 · ♥ 2

Params

7.2B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-04-15

mistral-7b-instruct-v0.1-4bit-ngs

mlx-community/mistral-7b-instruct-v0.1-4bit-ngs

4-bit

Text generation ↓ 65 · ♥ 2

Params

7.2B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-02-09

AREX-Turbo-8bit

from BAAI/AREX-Turbo

8-bit

Text generation · BAAI ↓ 65 · ♥ 1

Params

4.5B

Weights

≈ 5.1 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-07-28

Apertus-8B-2509-4bit

from swiss-ai/Apertus-8B-2509

4-bit

Text generation · swiss-ai ↓ 65 · ♥ 1

Params

8.1B

Weights

≈ 4.5 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-09-03

Bernini-R-1.3B-int4

from ByteDance/Bernini-R-1.3B-Diffusers

Text to video · ByteDance ↓ 65 · ♥ 1

Params

1.4B

Weights

≈ 5.6 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-06-15

Devstral-Small-2507-6bit

from mlx-community/Devstral-Samll-2507-bf16

6-bit

Text generation ↓ 65 · ♥ 1

Params

24B

Weights

≈ 19.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-07-11

HY-MT1.5-1.8B-6bit

from tencent/HY-MT1.5-1.8B

6-bit

Text generation · tencent ↓ 65 · ♥ 1

Params

1.8B

Weights

≈ 1.5 GB

Mac memory

8 GB+

updated 2026-01-03

Llama-3-Groq-70B-Tool-Use-4bit

mlx-community/Llama-3-Groq-70B-Tool-Use-4bit

4-bit

Text generation ↓ 65 · ♥ 1

Params

71B

Weights

≈ 39.7 GB

Mac memory

48 GB+

llama3 · updated 2024-07-17

Mixtral-8x22B-Instruct-v0.1-8bit

mlx-community/Mixtral-8x22B-Instruct-v0.1-8bit

8-bit

Uncategorised ↓ 65 · ♥ 1

Params

141B

Weights

≈ 150 GB

Mac memory

192 GB+

apache-2.0 · updated 2024-04-17

Molmo-7B-D-0924-8bit

from Qwen/Qwen2-7B

8-bit

Vision + text · Qwen ↓ 65 · ♥ 1

Params

8.0B

Weights

≈ 9.0 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-12-27

Qwen3-18B-A3B-Stranger-Thoughts-Q_6

from DavidAU/Qwen3-18B-A3B-Stranger-Thoughts

6-bit

Text generation · DavidAU ↓ 65 · ♥ 1

Params

17B

Weights

≈ 14.1 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-06-28

TinyMistral-248M-8bits

mlx-community/TinyMistral-248M-8bits

8-bit

Text generation ↓ 65 · ♥ 1

Params

248M

Weights

≈ 264 MB

Mac memory

8 GB+

apache-2.0 · updated 2024-06-28

codegemma-1.1-7b-it-4bit

mlx-community/codegemma-1.1-7b-it-4bit

4-bit

Text generation ↓ 65 · ♥ 1

Params

8.5B

Weights

≈ 4.8 GB

Mac memory

8 GB+

gemma · updated 2024-05-03

glm-4-9b-chat-1m-6bit

from zai-org/glm-4-9b-chat-1m-hf

6-bit

Text generation · zai-org ↓ 65 · ♥ 1

Params

9.5B

Weights

≈ 7.7 GB

Mac memory

16 GB+

glm-4 · updated 2025-09-14

AI21-Jamba-Reasoning-3B-bf16

from ai21labs/AI21-Jamba-Reasoning-3B

bf16

Text generation · AI21 · Jamba ↓ 65 · ♥ 0

Params

3.0B

Weights

≈ 6.1 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-10-14

Dolphin-Mistral-24B-Venice-Edition-5bit

from dphn/Dolphin-Mistral-24B-Venice-Edition

5-bit

Text generation · dphn ↓ 65 · ♥ 0

Params

24B

Weights

≈ 16.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-07-06

ERNIE-4.5-VL-28B-A3B-Thinking-4bit

mlx-community/ERNIE-4.5-VL-28B-A3B-Thinking-4bit

4-bit

Vision + text ↓ 65 · ♥ 0

Params

29B

Weights

≈ 17.4 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-01-28

MiMo-V2.5-ASR-MLX-fp32

from XiaomiMiMo/MiMo-V2.5-ASR

fp32

Speech recognition · XiaomiMiMo ↓ 65 · ♥ 0

Params

7.6B

Weights

≈ 32.1 GB

Mac memory

48 GB+

apache-2.0 · updated 2026-05-30

MiniCPM-o-4_5-5bit

mlx-community/MiniCPM-o-4_5-5bit

5-bit

Any to any ↓ 65 · ♥ 0

Params

9.0B

Weights

≈ 7.2 GB

Mac memory

16 GB+

apache-2.0 · updated 2026-03-06

Ministral-3-14B-Instruct-2512-mxfp8

from mistralai/Ministral-3-14B-Base-2512

MXFP8

Uncategorised · Mistral ↓ 65 · ♥ 0

Params

14B

Weights

≈ 15.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-02-13

Qwen2.5-1.5B-8bit

mlx-community/Qwen2.5-1.5B-8bit

8-bit

Text generation ↓ 65 · ♥ 0

Params

1.5B

Weights

≈ 1.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2024-09-18

bitnet-b1.58-2B-4T-8bit

from microsoft/bitnet-b1.58-2B-4T

8-bit

Text generation · Microsoft · Phi ↓ 65 · ♥ 0

Params

614M

Weights

≈ 662 MB

Mac memory

8 GB+

mit · updated 2025-06-10

gemma-3-4b-it-wikisql-finetuned-4bit

from mlx-community/gemma-3-4b-it-qat-4bit

4-bit

Text generation ↓ 65 · ♥ 0

Params

4.6B

Weights

≈ 2.6 GB

Mac memory

8 GB+

qwen · updated 2025-08-30

llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

mlx-community/llm-jp-13b-instruct-full-ac_001-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit

4-bit

Text generation ↓ 65 · ♥ 0

Params

14B

Weights

≈ 7.7 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-04-30

llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

mlx-community/llm-jp-13b-instruct-full-ac_001_16x-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-8bit

8-bit

Text generation ↓ 65 · ♥ 0

Params

14B

Weights

≈ 14.5 GB

Mac memory

24 GB+

apache-2.0 · updated 2024-04-30

gemma-3n-E4B-bf16

mlx-community/gemma-3n-E4B-bf16

bf16

Vision + text ↓ 64 · ♥ 7

Params

8.4B

Weights

≈ 15.7 GB

Mac memory

24 GB+

gemma · updated 2025-07-12

Jan-nano-8bit

from Menlo/Jan-nano

8-bit

Text generation · Menlo ↓ 64 · ♥ 5

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-06-16

QwQ-32B-Preview-3bit

from Qwen/QwQ-32B-Preview

3-bit

Text generation · Qwen ↓ 64 · ♥ 5

Params

33B

Weights

≈ 14.3 GB

Mac memory

24 GB+

apache-2.0 · updated 2024-11-28

LFM2.5-Audio-1.5B-8bit

from LiquidAI/LFM2-1.2B

8-bit

Audio to audio · LiquidAI ↓ 64 · ♥ 4

Params

1.5B

Weights

≈ 1.7 GB

Mac memory

8 GB+

lfm1.0 · updated 2026-01-15

QwQ-32B-6bit

from Qwen/QwQ-32B

6-bit

Text generation · Qwen ↓ 64 · ♥ 3

Params

33B

Weights

≈ 26.6 GB

Mac memory

32 GB+

apache-2.0 · updated 2025-03-05

Llama-4-Maverick-17B-16E-Instruct-6bit

from meta-llama/Llama-4-Maverick-17B-128E-Instruct

6-bit

Text generation · Meta · Llama ↓ 64 · ♥ 2

Params

401B

Weights

≈ 326 GB

Mac memory

512 GB+

llama4 · updated 2025-04-06

SenseNova-U1.5-8B-MoT-8bit

from sensenova/SenseNova-U1.5-8B-MoT

8-bit

Any to any · sensenova ↓ 64 · ♥ 2

Params

18B

Weights

≈ 19.9 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-08-24

meta-llama-Llama-4-Scout-17B-16E-bf16

from meta-llama/Llama-4-Scout-17B-16E

bf16

Text generation · Meta · Llama ↓ 64 · ♥ 2

Params

108B

Weights

≈ 216 GB

Mac memory

256 GB+

llama4 · updated 2025-04-06

LFM2.5-2.6B-bf16

from LiquidAI/LFM2.5-2.6B

bf16

Text generation · LiquidAI ↓ 64 · ♥ 1

Params

2.7B

Weights

≈ 5.4 GB

Mac memory

16 GB+

lfm1.0 · updated 2026-08-13

Qwen3-VL-30B-A3B-Thinking-4bit

mlx-community/Qwen3-VL-30B-A3B-Thinking-4bit

4-bit

Vision + text ↓ 64 · ♥ 1

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-10-14

VOSR2-fp16

from CSWRY/VOSR

fp16

Image to image · CSWRY ↓ 64 · ♥ 1

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2026-09-26

gemma-4-31B-it-qat-nvfp4

mlx-community/gemma-4-31B-it-qat-nvfp4

4-bit

Vision + text ↓ 64 · ♥ 1

Params

31B

Weights

≈ 18.4 GB

Mac memory

24 GB+

updated 2026-06-05

3b-zh-ft-research_release-bf16

from canopylabs/orpheus-3b-0.1-pretrained

bf16

Text to speech · canopylabs ↓ 64 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-04-09

DeepSeek-OCR-2-5bit

mlx-community/DeepSeek-OCR-2-5bit

5-bit

Vision + text ↓ 64 · ♥ 0

Params

3.4B

Weights

≈ 2.9 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-28

DeepSeek-R1-Distill-Qwen-32B-float16

from deepseek-ai/DeepSeek-R1-Distill-Qwen-32B

Text generation · DeepSeek ↓ 64 · ♥ 0

Params

33B

Weights

≈ 65.5 GB

Mac memory

96 GB+

mit · updated 2025-06-20