Skip to content

Hunyuan-1.8B-Instruct-4bit

mlx-community/Hunyuan-1.8B-Instruct-4bit
4-bit Open on Hugging Face
Parameters
1.8B
Weights (est.)
≈ 1.0 GB
Mac memory (est.)
8 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Hunyuan-1.8B-Instruct-4bit --prompt "Hello"

Details

Base model
tencent/Hunyuan-1.8B-Instruct (quantized)
Vendor
tencent
Task
Text generation
Quantisation
4-bit
Licence
—
Downloads
54 in the last 30 days · 562 all time · 1 likes
Published
2025-08-04 · updated 2025-08-04 (1y ago)
Tags
hunyuan_v1_dense

Other MLX builds of tencent/Hunyuan-1.8B-Instruct

Build Quantisation Weights Mac memory Downloads
Hunyuan-1.8B-Instruct-4bit (this one) 4-bit ≈ 1.0 GB 8 GB+ 54
Hunyuan-1.8B-Instruct-8bit 8-bit ≈ 1.9 GB 8 GB+ 23