Skip to content

all-MiniLM-L6-v2-8bit

mlx-community/all-MiniLM-L6-v2-8bit
Sentence similarity · sentence-transformers
8-bit Open on Hugging Face
Parameters
23M
Weights (est.)
≈ 24 MB
Mac memory (est.)
8 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
—
Vendor
—
Task
Sentence similarity
Quantisation
8-bit
Licence
apache-2.0
Downloads
70 in the last 30 days · 1.5K all time · 0 likes
Published
2025-04-02 · updated 2025-04-02 (1y ago)
Languages
en
Tags
sentence-transformers, bert, feature-extraction, text-embeddings-inference