Qwen1.5-110B-Chat-4bit
mlx-community/Qwen1.5-110B-Chat-4bit
Params
111B
Weights
≈ 62.6 GB
Mac memory
96 GB+
tongyi-qianwen · updated 2024-04-26
Apple silicon
Apple MLX models
5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 58m ago. Weights size and Mac memory are estimates from parameter count and quantisation.
Alert me about new Apple/MLX models
2,922 builds · page 24 of 49 · clear filters
stable-code-instruct-3b-4bit
mlx-community/stable-code-instruct-3b-4bit
Params
2.8B
Weights
≈ 1.8 GB
Mac memory
8 GB+
other · updated 2024-03-25
Nanbeige4.1-3B-bf16
from Nanbeige/Nanbeige4.1-3B
Params
3.9B
Weights
≈ 7.9 GB
Mac memory
16 GB+
apache-2.0 · updated 2026-02-11
Qwen3.6-27B-MTP-bf16
from Qwen/Qwen3.6-27B
Params
425M
Weights
≈ 849 MB
Mac memory
8 GB+
apache-2.0 · updated 2026-06-01
DeepHermes-3-Llama-3-8B-Preview-4Bit
from NousResearch/DeepHermes-3-Llama-3-8B-Preview
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+
llama3 · updated 2025-02-13
LFM2.5-1.2B-Instruct-bf16
from LiquidAI/LFM2.5-1.2B-Instruct
Params
1.2B
Weights
≈ 2.3 GB
Mac memory
8 GB+
lfm1.0 · updated 2026-08-13
Josiefied-Qwen3-4B-abliterated-v1-bf16
from Goekdeniz-Guelmez/Josiefied-Qwen3-4B-abliterated-v1
Params
4.0B
Weights
≈ 8.0 GB
Mac memory
16 GB+
updated 2025-05-01
Qwen3-30B-A3B-Instruct-2507-6bit-DWQ-lr1e-8
from Qwen/Qwen3-30B-A3B-Instruct-2507
Params
31B
Weights
≈ 24.8 GB
Mac memory
32 GB+
apache-2.0 · updated 2025-08-02
Qwen3-Next-80B-A3B-Thinking-6bit
from Qwen/Qwen3-Next-80B-A3B-Thinking
Params
80B
Weights
≈ 64.7 GB
Mac memory
96 GB+
apache-2.0 · updated 2025-09-13
functiongemma-270m-it-8bit
from google/functiongemma-270m-it
Params
268M
Weights
≈ 285 MB
Mac memory
8 GB+
gemma · updated 2025-12-18
qwen3.5-27b-claude-opus-8bit-text-only
mlx-community/qwen3.5-27b-claude-opus-8bit-text-only
Params
27B
Weights
≈ 28.6 GB
Mac memory
48 GB+
updated 2026-03-31
Baichuan-M1-14B-Instruct
from baichuan-inc/Baichuan-M1-14B-Instruct
Params
14B
Weights
≈ 28.9 GB
Mac memory
48 GB+
updated 2025-04-24
Bio-Medical-3B-CoT-012025
from ContactDoctor/Bio-Medical-3B-CoT-012025
Params
3.1B
Weights
≈ 1.7 GB
Mac memory
8 GB+
other · updated 2025-01-26
Meta-Llama-Guard-2-8B-4bit
mlx-community/Meta-Llama-Guard-2-8B-4bit
Params
8.0B
Weights
≈ 5.3 GB
Mac memory
8 GB+
llama3 · updated 2024-04-19
Unsloth-Phi-4-mini-instruct-4bit
from unsloth/Phi-4-mini-instruct
Params
3.8B
Weights
≈ 2.2 GB
Mac memory
8 GB+
mit · updated 2025-05-29
VulnLLM-R-7B-6bit
from Virtue-AI-HUB/VulnLLM-R-7B
Params
7.6B
Weights
≈ 6.2 GB
Mac memory
16 GB+
apache-2.0 · updated 2026-01-02
c4ai-command-r7b-12-2024-6bit
from CohereLabs/c4ai-command-r7b-12-2024
Params
8.0B
Weights
≈ 6.5 GB
Mac memory
16 GB+
cc-by-nc-4.0 · updated 2024-12-16
llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit
mlx-community/llm-jp-13b-instruct-full-dolly-ichikara_004_001_single-oasst-oasst2-v2.0-4bit
Params
14B
Weights
≈ 7.7 GB
Mac memory
16 GB+
apache-2.0 · updated 2024-04-30
QwQ-32B-Preview-8bit
from Qwen/QwQ-32B-Preview
Params
33B
Weights
≈ 34.8 GB
Mac memory
48 GB+
apache-2.0 · updated 2024-11-27
Jan-v3-4B-base-instruct-8bit
from janhq/Jan-v3-4B-base-instruct
Params
4.0B
Weights
≈ 4.3 GB
Mac memory
8 GB+
apache-2.0 · updated 2026-01-27
Jan-nano-128k-4bit
from Menlo/Jan-nano-128k
Params
4.0B
Weights
≈ 2.3 GB
Mac memory
8 GB+
apache-2.0 · updated 2025-06-26
Meta-Llama-3.1-405B-2bit
mlx-community/Meta-Llama-3.1-405B-2bit
Params
410B
Weights
≈ 128 GB
Mac memory
192 GB+
llama3.1 · updated 2024-07-24
Phi-3-medium-128k-instruct-8bit
mlx-community/Phi-3-medium-128k-instruct-8bit
Params
14B
Weights
≈ 14.8 GB
Mac memory
24 GB+
mit · updated 2024-07-11
granite-4.0-h-tiny-3bit-MLX
from ibm-granite/granite-4.0-h-tiny
Params
6.9B
Weights
≈ 3.0 GB
Mac memory
8 GB+
apache-2.0 · updated 2025-10-03
Qwen2.5-72B-Instruct-4bit-AWQ
from Qwen/Qwen2.5-72B-Instruct
Params
73B
Weights
≈ 40.9 GB
Mac memory
48 GB+
qwen · updated 2025-04-26
Qwen3-4B-Instruct-2507-gabliterated-8bit
from Goekdeniz-Guelmez/Qwen3-4B-Instruct-2507-gabliterated
Params
4.0B
Weights
≈ 4.3 GB
Mac memory
8 GB+
updated 2026-01-06
AceReason-Nemotron-14B-4bit
from nvidia/AceReason-Nemotron-14B
Params
15B
Weights
≈ 8.3 GB
Mac memory
16 GB+
nvidia-open-model-license · updated 2025-05-24
Falcon3-Mamba-7B-Instruct-8bits
from tiiuae/Falcon3-Mamba-7B-Instruct
Params
7.3B
Weights
≈ 7.7 GB
Mac memory
16 GB+
falcon-llm-license · updated 2025-02-14
GLM-4.5-Air-nvfp4
from zai-org/GLM-4.5-Air
Params
107B
Weights
≈ 60.1 GB
Mac memory
96 GB+
mit · updated 2026-05-06
LFM2-350M-ENJP-MT-8bit
from LiquidAI/LFM2-350M-ENJP-MT
Params
354M
Weights
≈ 377 MB
Mac memory
8 GB+
lfm1.0 · updated 2025-09-05
LFM2.5-350M-6bit
from LiquidAI/LFM2.5-350M
Params
354M
Weights
≈ 288 MB
Mac memory
8 GB+
lfm1.0 · updated 2026-08-13
Llama-3-ELYZA-JP-8B-4bit
mlx-community/Llama-3-ELYZA-JP-8B-4bit
Params
8.0B
Weights
≈ 4.5 GB
Mac memory
8 GB+
llama3 · updated 2024-06-26
Mellum-4b-sft-python-4bit
from JetBrains/Mellum-4b-sft-python
Params
4.0B
Weights
≈ 2.3 GB
Mac memory
8 GB+
apache-2.0 · updated 2025-06-28
Meta-Llama-3.1-8B-Instruct-abliterated-2bit
mlx-community/Meta-Llama-3.1-8B-Instruct-abliterated-2bit
Params
8.0B
Weights
≈ 2.5 GB
Mac memory
8 GB+
llama3.1 · updated 2024-08-03
Qwen2.5-32B-8bit
mlx-community/Qwen2.5-32B-8bit
Params
33B
Weights
≈ 34.8 GB
Mac memory
48 GB+
apache-2.0 · updated 2024-09-18
Violet-Lyra-Gutenberg-4bit
from ohyeah1/Violet-Lyra-Gutenberg
Params
12B
Weights
≈ 6.9 GB
Mac memory
16 GB+
updated 2025-02-24
gemma-4-12B-it-qat-assistant-mxfp4
from google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
Params
423M
Weights
≈ 238 MB
Mac memory
8 GB+
gemma · updated 2026-06-05
granite-20b-code-instruct-4bit
from ibm-granite/granite-20b-code-base-8k
Params
20B
Weights
≈ 11.3 GB
Mac memory
16 GB+
apache-2.0 · updated 2024-05-14
Hy3-oQ2e
from tencent/Hy3
Params
295B
Weights
≈ 92.3 GB
Mac memory
128 GB+
apache-2.0 · updated 2026-07-15
DeepCoder-14B-Preview-8bit
from agentica-org/DeepCoder-14B-Preview
Params
15B
Weights
≈ 15.7 GB
Mac memory
24 GB+
mit · updated 2025-04-08
granite-3.3-8b-instruct-fp16
from ibm-granite/granite-3.3-8b-instruct
Params
8.2B
Weights
≈ 16.3 GB
Mac memory
24 GB+
apache-2.0 · updated 2025-04-16
LFM2-1.2B-8bit
from LiquidAI/LFM2-1.2B
Params
1.2B
Weights
≈ 1.2 GB
Mac memory
8 GB+
lfm1.0 · updated 2025-07-12
Qwen3-30B-A3B-4bit-DWQ-10072025
from Qwen/Qwen3-30B-A3B
Params
31B
Weights
≈ 17.2 GB
Mac memory
24 GB+
apache-2.0 · updated 2025-07-10
ERNIE-4.5-0.3B-PT-4bit
from baidu/ERNIE-4.5-0.3B-PT
Params
361M
Weights
≈ 203 MB
Mac memory
8 GB+
apache-2.0 · updated 2025-07-02
Josiefied-Qwen3-8B-abliterated-v1-6bit
from Goekdeniz-Guelmez/Josiefied-Qwen3-8B-abliterated-v1
Params
8.2B
Weights
≈ 6.7 GB
Mac memory
16 GB+
updated 2025-05-02
Meta-Llama-3.1-70B-8bit
mlx-community/Meta-Llama-3.1-70B-8bit
Params
71B
Weights
≈ 75.0 GB
Mac memory
96 GB+
llama3.1 · updated 2024-07-24
QwQ-32B-Coder-Fusion-9010-4bit
from huihui-ai/QwQ-32B-Coder-Fusion-9010
Params
33B
Weights
≈ 18.4 GB
Mac memory
24 GB+
apache-2.0 · updated 2024-12-11
Qwen_QwQ-32B-Preview_MLX-4bit
from Qwen/QwQ-32B-Preview
Params
33B
Weights
≈ 18.4 GB
Mac memory
24 GB+
apache-2.0 · updated 2024-11-28
defog-llama-3-sqlcoder-8b
mlx-community/defog-llama-3-sqlcoder-8b
Params
8.0B
Weights
≈ 16.1 GB
Mac memory
24 GB+
cc-by-sa-4.0 · updated 2024-05-10
granite-34b-code-instruct-4bit
from ibm-granite/granite-34b-code-base-8k
Params
34B
Weights
≈ 19.0 GB
Mac memory
24 GB+
apache-2.0 · updated 2024-05-14
Falcon-H1-Tiny-Coder-90M-bf16
from tiiuae/Falcon-H1-Tiny-Coder-90M
Params
91M
Weights
≈ 182 MB
Mac memory
8 GB+
falcon-llm-license · updated 2026-01-28
GLM-4-32B-Base-0414-6bit
from zai-org/GLM-4-32B-Base-0414
Params
33B
Weights
≈ 26.5 GB
Mac memory
32 GB+
mit · updated 2025-04-21
Mistral-7B-v0.1-4bit-fused
mlx-community/Mistral-7B-v0.1-4bit-fused
Params
—
Weights
—
Mac memory
—
apache-2.0 · updated 2024-01-11
Qwen2.5-0.5B-8bit
mlx-community/Qwen2.5-0.5B-8bit
Params
494M
Weights
≈ 525 MB
Mac memory
8 GB+
apache-2.0 · updated 2024-09-18
Qwen2.5-7B-bf16
mlx-community/Qwen2.5-7B-bf16
Params
7.6B
Weights
≈ 15.2 GB
Mac memory
24 GB+
apache-2.0 · updated 2024-09-18
Seed-OSS-36B-Instruct-8bit
from ByteDance-Seed/Seed-OSS-36B-Instruct
Params
36B
Weights
≈ 38.4 GB
Mac memory
48 GB+
apache-2.0 · updated 2025-09-03
codegemma-7b-4bit
mlx-community/codegemma-7b-4bit
Params
8.5B
Weights
≈ 5.9 GB
Mac memory
16 GB+
gemma · updated 2024-04-09
gemma-4-12B-it-qat-assistant-5bit
from google/gemma-4-12B-it-qat-q4_0-unquantized-assistant
Params
423M
Weights
≈ 291 MB
Mac memory
8 GB+
gemma · updated 2026-06-05
glm-4-9b-chat-1m-8bit
from zai-org/glm-4-9b-chat-1m-hf
Params
9.5B
Weights
≈ 10.1 GB
Mac memory
16 GB+
glm-4 · updated 2025-09-14
llm-jp-3-8x1.8b-instruct3
from llm-jp/llm-jp-3-8x1.8b-instruct3
Params
9.3B
Weights
≈ 18.5 GB
Mac memory
24 GB+
apache-2.0 · updated 2025-03-27