Apple MLX models

Homunculus-8bit

from arcee-ai/Homunculus

8-bit

Text generation · arcee-ai ↓ 19 · ♥ 0

Params

12B

Weights

≈ 13.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-06-03

Hunyuan-A13B-Instruct-bf16

from tencent/Hunyuan-A13B-Instruct

bf16

Text generation · tencent ↓ 19 · ♥ 0

Params

80B

Weights

≈ 161 GB

Mac memory

192 GB+

tencent-hunyuan-a13b · updated 2025-07-13

JOSIE-1.1-4B-Instruct-8bit

from Goekdeniz-Guelmez/JOSIE-1.1-4B-Instruct

8-bit

Text generation · Goekdeniz-Guelmez ↓ 19 · ♥ 0

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

mit · updated 2026-03-09

Josiefied-Olmo-3-7B-Instruct-abliterated-v1-bfloat16

from Goekdeniz-Guelmez/Josiefied-Olmo-3-7B-Instruct-abliterated-v1

Text generation · Goekdeniz-Guelmez ↓ 19 · ♥ 0

Params

7.3B

Weights

≈ 14.6 GB

Mac memory

24 GB+

updated 2025-11-25

LLaDA2.0-flash-6bit

from inclusionAI/LLaDA2.0-flash

6-bit

Text generation · inclusionAI ↓ 19 · ♥ 0

Params

103B

Weights

≈ 83.6 GB

Mac memory

96 GB+

apache-2.0 · updated 2025-11-26

Lingshu-7B-6bit

mlx-community/Lingshu-7B-6bit

6-bit

Vision + text ↓ 19 · ♥ 0

Params

—

Weights

—

Mac memory

—

mit · updated 2025-06-12

Llama-3.1-SuperNova-Lite-4bit

from meta-llama/Llama-3.1-8B-Instruct

4-bit

Uncategorised · Meta · Llama ↓ 19 · ♥ 0

Params

8.0B

Weights

≈ 4.5 GB

Mac memory

8 GB+

llama3 · updated 2024-09-11

LongCat-Flash-Thinking-2601-8bit

from meituan-longcat/LongCat-Flash-Thinking-2601

8-bit

Text generation · meituan-longcat ↓ 19 · ♥ 0

Params

561B

Weights

≈ 596 GB

Mac memory

> 512 GB

mit · updated 2026-01-18

Lumimaid-70B-v0.1

from NeverSleep/Llama-3-Lumimaid-70B-v0.1

8-bit

Uncategorised · NeverSleep ↓ 19 · ♥ 0

Params

71B

Weights

≈ 75.0 GB

Mac memory

96 GB+

cc-by-nc-4.0 · updated 2024-10-13

MedFound-Llama3-8B-finetuned

from medicalai/MedFound-Llama3-8B-finetuned

4-bit

Uncategorised · medicalai ↓ 19 · ♥ 0

Params

8.0B

Weights

≈ 4.5 GB

Mac memory

8 GB+

afl-3.0 · updated 2025-01-26

Olmo-3-7B-Instruct-SFT-8bit

from allenai/Olmo-3-7B-Instruct-SFT

8-bit

Text generation · Ai2 · OLMo ↓ 19 · ♥ 0

Params

7.3B

Weights

≈ 7.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-11-20

Olmo-3-7B-Think-SFT-6bit

from allenai/Olmo-3-7B-Think-SFT

6-bit

Text generation · Ai2 · OLMo ↓ 19 · ♥ 0

Params

7.3B

Weights

≈ 5.9 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-11-21

Olmo-3-7B-Think-SFT-8bit

from allenai/Olmo-3-7B-Think-SFT

8-bit

Text generation · Ai2 · OLMo ↓ 19 · ♥ 0

Params

7.3B

Weights

≈ 7.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-11-21

RakutenAI-2.0-mini-instruct-8bit

from Rakuten/RakutenAI-2.0-mini-instruct

8-bit

Uncategorised · Rakuten ↓ 19 · ♥ 0

Params

1.5B

Weights

≈ 1.6 GB

Mac memory

8 GB+

apache-2.0 · updated 2025-02-19

Ring-flash-linear-2.0-128k-6bit

from inclusionAI/Ring-flash-linear-2.0-128k

6-bit

Text generation · inclusionAI ↓ 19 · ♥ 0

Params

104B

Weights

≈ 84.6 GB

Mac memory

128 GB+

mit · updated 2025-11-07

SERA-8B-GA-6bit

from allenai/SERA-8B-GA

6-bit

Text generation · Ai2 · OLMo ↓ 19 · ♥ 0

Params

8.2B

Weights

≈ 6.7 GB

Mac memory

16 GB+

updated 2026-01-27

SU-01-mxfp4

from Simplified-Reasoning/SU-01

MXFP4

Text generation · Simplified-Reasoning ↓ 19 · ♥ 0

Params

31B

Weights

≈ 17.2 GB

Mac memory

24 GB+

apache-2.0 · updated 2026-05-16

SenseNova-U1.5-8B-MoT-pose-8bit

from sensenova/SenseNova-U1.5-8B-MoT

8-bit

Image to image · sensenova ↓ 19 · ♥ 0

Params

18B

Weights

≈ 19.9 GB

Mac memory

32 GB+

apache-2.0 · updated 2026-09-02

Soprano-80M-6bit

mlx-community/Soprano-80M-6bit

6-bit

Text to speech ↓ 19 · ♥ 0

Params

94M

Weights

≈ 79 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-04

VL-Rethinker-72B-6bit

from Qwen/Qwen2.5-VL-7B-Instruct

6-bit

Visual question answering · Qwen ↓ 19 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-04-16

VL-Rethinker-72B-fp16

from Qwen/Qwen2.5-VL-7B-Instruct

fp16

Visual question answering · Qwen ↓ 19 · ♥ 0

Params

—

Weights

—

Mac memory

—

apache-2.0 · updated 2025-04-16

VL-Rethinker-7B-fp16

from Qwen/Qwen2.5-VL-7B-Instruct

fp16

Visual question answering · Qwen ↓ 19 · ♥ 0

Params

8.3B

Weights

≈ 16.6 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-04-16

X-Ray-Alpha

from SicariusSicariiStuff/X-Ray_Alpha

4-bit

Uncategorised · SicariusSicariiStuff ↓ 19 · ♥ 0

Params

3.9B

Weights

≈ 2.2 GB

Mac memory

8 GB+

gemma · updated 2026-01-15

Yi-6B-Chat-hf-4bit-mlx

mlx-community/Yi-6B-Chat-hf-4bit-mlx

4-bit

Text generation ↓ 19 · ♥ 0

Params

—

Weights

—

Mac memory

—

yi-license · updated 2024-01-05

deepcogito-cogito-v1-preview-llama-8B-6bit

from deepcogito/cogito-v1-preview-llama-8B

6-bit

Text generation · deepcogito ↓ 19 · ♥ 0

Params

8.0B

Weights

≈ 6.5 GB

Mac memory

16 GB+

llama3.1 · updated 2025-04-08

deepcogito-cogito-v1-preview-llama-8B-8bit

from deepcogito/cogito-v1-preview-llama-8B

8-bit

Text generation · deepcogito ↓ 19 · ♥ 0

Params

8.0B

Weights

≈ 8.5 GB

Mac memory

16 GB+

llama3.1 · updated 2025-04-08

dolphin-2.8-mistral-7b-v02-8bit

from mistral-community/Mistral-7B-v0.2

8-bit

Uncategorised · mistral-community ↓ 19 · ♥ 0

Params

7.2B

Weights

≈ 7.8 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-04-06

dolphin-2.9.2-Phi-3-Medium-2bit

from unsloth/Phi-3-mini-4k-instruct

2-bit

Uncategorised · unsloth ↓ 19 · ♥ 0

Params

1.3B

Weights

≈ 1.1 GB

Mac memory

8 GB+

mit · updated 2024-06-02

gemma-3-270m-qat-bf16

from google/gemma-3-270m-qat

bf16

Text generation · Google · Gemma ↓ 19 · ♥ 0

Params

436M

Weights

≈ 872 MB

Mac memory

8 GB+

gemma · updated 2025-08-09

kitten-tts-nano-0.8-4bit

mlx-community/kitten-tts-nano-0.8-4bit

4-bit

Text to speech ↓ 19 · ♥ 0

Params

15M

Weights

≈ 30 MB

Mac memory

8 GB+

updated 2026-02-24

mamba2-370m-4bit

from rokyang/mamba2-370m-hf

4-bit

Uncategorised · rokyang ↓ 19 · ♥ 0

Params

58M

Weights

≈ 50 MB

Mac memory

8 GB+

apache-2.0 · updated 2025-01-21

orpheus-3b-0.1-pretrained-bf16

from canopylabs/orpheus-3b-0.1-pretrained

bf16

Text generation · canopylabs ↓ 19 · ♥ 0

Params

3.3B

Weights

≈ 6.6 GB

Mac memory

16 GB+

apache-2.0 · updated 2025-04-02

paligemma2-10b-mix-448-4bit

mlx-community/paligemma2-10b-mix-448-4bit

4-bit

Vision + text ↓ 19 · ♥ 0

Params

9.7B

Weights

≈ 6.0 GB

Mac memory

16 GB+

gemma · updated 2025-02-19

whisper-base-asr-6bit

mlx-community/whisper-base-asr-6bit

6-bit

Speech recognition ↓ 19 · ♥ 0

Params

72M

Weights

≈ 60 MB

Mac memory

8 GB+

apache-2.0 · updated 2026-01-15

OpenELM-270M

mlx-community/OpenELM-270M

Uncategorised ↓ 18 · ♥ 3

Params

272M

Weights

≈ 543 MB

Mac memory

8 GB+

apple-sample-code-license · updated 2024-04-24

firefunction-v2-8bit

mlx-community/firefunction-v2-8bit

8-bit

Uncategorised ↓ 18 · ♥ 3

Params

71B

Weights

≈ 75.0 GB

Mac memory

96 GB+

llama3 · updated 2024-06-19

JOSIE-4B-Instruct-8bit

from Goekdeniz-Guelmez/JOSIE-4B-Instruct

8-bit

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 1

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

mit · updated 2026-02-12

Jan-v2-VL-high-bf16-mlx

from janhq/Jan-v2-VL-high

bf16

Uncategorised · janhq ↓ 18 · ♥ 1

Params

8.8B

Weights

≈ 17.5 GB

Mac memory

24 GB+

apache-2.0 · updated 2025-11-15

OpenELM-450M-8bit

mlx-community/OpenELM-450M-8bit

8-bit

Uncategorised ↓ 18 · ♥ 1

Params

457M

Weights

≈ 486 MB

Mac memory

8 GB+

apple-sample-code-license · updated 2024-04-24

V-JEPA2-AC-vitg

mlx-community/V-JEPA2-AC-vitg

Video classification ↓ 18 · ♥ 1

Params

1.3B

Weights

≈ 2.6 GB

Mac memory

8 GB+

mit · updated 2026-06-06

Yi-1.5-9B-Chat-8bit

mlx-community/Yi-1.5-9B-Chat-8bit

8-bit

Uncategorised ↓ 18 · ♥ 1

Params

8.8B

Weights

≈ 9.4 GB

Mac memory

16 GB+

apache-2.0 · updated 2024-05-13

granite-4.0-1b-speech-mxfp4

from ibm-granite/granite-4.0-1b-base

MXFP4

Uncategorised · IBM · Granite ↓ 18 · ♥ 1

Params

2.3B

Weights

≈ 2.0 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-11

kitten-tts-nano-0.8-5bit

mlx-community/kitten-tts-nano-0.8-5bit

5-bit

Text to speech ↓ 18 · ♥ 1

Params

15M

Weights

≈ 31 MB

Mac memory

8 GB+

updated 2026-02-24

EXAONE-Deep-2.4B-6bit

from LGAI-EXAONE/EXAONE-Deep-2.4B

6-bit

Text generation · LGAI-EXAONE ↓ 18 · ♥ 0

Params

2.4B

Weights

≈ 2.0 GB

Mac memory

8 GB+

exaone · updated 2025-03-18

EXAONE-Deep-32B-6bit

from LGAI-EXAONE/EXAONE-Deep-32B

6-bit

Text generation · LGAI-EXAONE ↓ 18 · ♥ 0

Params

32B

Weights

≈ 26.0 GB

Mac memory

32 GB+

exaone · updated 2025-03-18

Falcon3-1B-Instruct-8bit

from tiiuae/Falcon3-1B-Instruct

8-bit

Text generation · TII · Falcon ↓ 18 · ♥ 0

Params

1.7B

Weights

≈ 1.8 GB

Mac memory

8 GB+

falcon-llm-license · updated 2024-12-17

Hunyuan-7B-Instruct-3bit

from tencent/Hunyuan-7B-Instruct

3-bit

Text generation · tencent ↓ 18 · ♥ 0

Params

7.5B

Weights

≈ 3.3 GB

Mac memory

8 GB+

tencent-license · updated 2025-02-08

Irodori-TTS-500M-v2-8bit

mlx-community/Irodori-TTS-500M-v2-8bit

8-bit

Text to speech ↓ 18 · ♥ 0

Params

495M

Weights

≈ 645 MB

Mac memory

8 GB+

mit · updated 2026-04-20

Irodori-TTS-500M-v2-fp16

mlx-community/Irodori-TTS-500M-v2-fp16

fp16

Text to speech ↓ 18 · ♥ 0

Params

495M

Weights

≈ 990 MB

Mac memory

8 GB+

mit · updated 2026-04-20

JOSIE-4B-Instruct-bfloat16

from Goekdeniz-Guelmez/JOSIE-4B-Instruct

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 0

Params

4.0B

Weights

≈ 8.0 GB

Mac memory

16 GB+

mit · updated 2026-02-12

JOSIE-4B-Thinking-4bit

from Goekdeniz-Guelmez/JOSIE-4B-Thinking

4-bit

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 0

Params

4.0B

Weights

≈ 2.3 GB

Mac memory

8 GB+

mit · updated 2026-02-12

JOSIE-4B-Thinking-6bit

from Goekdeniz-Guelmez/JOSIE-4B-Thinking

6-bit

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 0

Params

4.0B

Weights

≈ 3.3 GB

Mac memory

8 GB+

mit · updated 2026-02-12

JOSIE-4B-Thinking-8bit

from Goekdeniz-Guelmez/JOSIE-4B-Thinking

8-bit

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 0

Params

4.0B

Weights

≈ 4.3 GB

Mac memory

8 GB+

mit · updated 2026-02-12

Josiefied-Olmo-3-7B-Instruct-abliterated-v1-6bit

from Goekdeniz-Guelmez/Josiefied-Olmo-3-7B-Instruct-abliterated-v1

6-bit

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 0

Params

7.3B

Weights

≈ 5.9 GB

Mac memory

16 GB+

updated 2025-11-25

Josiefied-Qwen3-0.6B-gabliterated-6bit

from Goekdeniz-Guelmez/Josiefied-Qwen3-0.6B-gabliterated-v1

6-bit

Text generation · Goekdeniz-Guelmez ↓ 18 · ♥ 0

Params

596M

Weights

≈ 484 MB

Mac memory

8 GB+

updated 2026-01-26

Laguna-M.1-mxfp8

from poolside/Laguna-M.1

MXFP8

Text generation · poolside ↓ 18 · ♥ 0

Params

226B

Weights

≈ 240 GB

Mac memory

512 GB+

apache-2.0 · updated 2026-06-18

Lens-Turbo-3.8B-bf16

from microsoft/Lens-Turbo

bf16

Text to image · Microsoft · Phi ↓ 18 · ♥ 0

Params

4.1B

Weights

≈ 8.2 GB

Mac memory

16 GB+

mit · updated 2026-06-21

Lingshu-7B-bf16

mlx-community/Lingshu-7B-bf16

bf16

Vision + text ↓ 18 · ♥ 0

Params

8.3B

Weights

≈ 16.6 GB

Mac memory

24 GB+

mit · updated 2025-06-12

MAI-UI-2B-bf16-v2

from Tongyi-MAI/MAI-UI-2B

bf16

Vision + text · Tongyi-MAI ↓ 18 · ♥ 0

Params

2.1B

Weights

≈ 4.3 GB

Mac memory

8 GB+

apache-2.0 · updated 2026-03-21

MiniMax-M2.1-REAP-40-8bit

from 0xSero/MiniMax-M2.1-139B

8-bit

Text generation · 0xSero ↓ 18 · ♥ 0

Params

139B

Weights

≈ 148 GB

Mac memory

192 GB+

apache-2.0 · updated 2026-01-14