Skip to content

Qwen3-Reranker-8B-mxfp8

mlx-community/Qwen3-Reranker-8B-mxfp8
Reranking · transformers
MXFP8 Open on Hugging Face
Parameters
—
Weights (est.)
—
Mac memory (est.)
—

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
Qwen/Qwen3-8B-Base (finetune)
Vendor
Qwen
Task
Reranking
Quantisation
MXFP8
Licence
apache-2.0
Downloads
231 in the last 30 days · 1.8K all time · 0 likes
Published
2026-02-11 · updated 2026-02-11 (9mo ago)
Tags
qwen3, text-generation

Other MLX builds of Qwen/Qwen3-8B-Base

Build Quantisation Weights Mac memory Downloads
Qwen3-8B-Base-bf16 bf16 ≈ 16.4 GB 24 GB+ 141
Qwen3-Embedding-8B-mxfp8 MXFP8 — — 1.0K
Qwen3-Reranker-8B-mxfp8 (this one) MXFP8 — — 231