Skip to content

Qwen3-Embedding-0.6B-8bit

mlx-community/Qwen3-Embedding-0.6B-8bit
Embeddings · mlx
8-bit Open on Hugging Face
Parameters
596M
Weights (est.)
≈ 633 MB
Mac memory (est.)
8 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
Qwen/Qwen3-Embedding-0.6B (finetune)
Vendor
Qwen
Task
Embeddings
Quantisation
8-bit
Licence
apache-2.0
Downloads
6.7K in the last 30 days · 39K all time · 2 likes
Published
2025-08-04 · updated 2026-07-14 (4mo ago)
Tags
qwen3, sentence-similarity, text-embeddings-inference

Other MLX builds of Qwen/Qwen3-Embedding-0.6B

Build Quantisation Weights Mac memory Downloads
Qwen3-Embedding-0.6B-4bit-DWQ 4-bit DWQ ≈ 335 MB 8 GB+ 32K
Qwen3-Embedding-0.6B-8bit (this one) 8-bit ≈ 633 MB 8 GB+ 6.7K
ACE-Step-1.5-text-encoder-bf16 bf16 ≈ 1.2 GB 8 GB+ 149