Yi-6B-Chat-4bit
from 01-ai/Yi-6B-Chat
Params
6.1B
Weights
≈ 3.4 GB
Mac memory
8 GB+
apache-2.0 · updated 2024-11-05
Apple silicon
Apple MLX models
5,841 models converted for Apple MLX, listed from Hugging Face’s mlx-community, refreshed 4m ago. Weights size and Mac memory are estimates from parameter count and quantisation.
Alert me about new Apple/MLX models
12 builds · clear filters
Yi-6B-Chat-8bit
from 01-ai/Yi-6B-Chat
Params
6.1B
Weights
≈ 6.4 GB
Mac memory
16 GB+
apache-2.0 · updated 2024-11-05
dolphin-2.9.1-yi-9b-2bit
from 01-ai/Yi-1.5-9B
Params
8.8B
Weights
≈ 2.8 GB
Mac memory
8 GB+
apache-2.0 · updated 2024-05-18
bagel-dpo-34b-v0.5-4bit-mlx
from 01-ai/yi-34b-200k
Params
34B
Weights
≈ 20.0 GB
Mac memory
32 GB+
yi-license · updated 2024-04-05
dolphin-2.9.1-yi-1.5-34b-4bit
from 01-ai/Yi-1.5-34B
Params
34B
Weights
≈ 19.3 GB
Mac memory
24 GB+
apache-2.0 · updated 2024-05-18
dolphin-2.9.3-Yi-1.5-34B-32k-8bit
from 01-ai/Yi-1.5-34B-32k
Params
9.7B
Weights
≈ 11.3 GB
Mac memory
16 GB+
apache-2.0 · updated 2024-06-23
dolphin-2.9.1-yi-1.5-34b-2bit
from 01-ai/Yi-1.5-34B
Params
34B
Weights
≈ 10.7 GB
Mac memory
16 GB+
apache-2.0 · updated 2024-05-18
dolphin-2.9.1-yi-1.5-34b-8bit
from 01-ai/Yi-1.5-34B
Params
34B
Weights
≈ 36.5 GB
Mac memory
48 GB+
apache-2.0 · updated 2024-05-18
dolphin-2.9.3-Yi-1.5-34B-32k-4bit
from 01-ai/Yi-1.5-34B-32k
Params
5.4B
Weights
≈ 4.6 GB
Mac memory
8 GB+
apache-2.0 · updated 2024-06-23
dolphin-2.9.1-yi-9b-8bit
from 01-ai/Yi-1.5-9B
Params
8.8B
Weights
≈ 9.4 GB
Mac memory
16 GB+
apache-2.0 · updated 2024-05-18
dolphin-2.9.3-Yi-1.5-34B-32k-2bit
from 01-ai/Yi-1.5-34B-32k
Params
3.2B
Weights
≈ 2.8 GB
Mac memory
8 GB+
apache-2.0 · updated 2024-06-23
dolphin-2.9.1-yi-9b-4bit
from 01-ai/Yi-1.5-9B
Params
8.8B
Weights
≈ 5.0 GB
Mac memory
8 GB+
apache-2.0 · updated 2024-05-18