Skip to content

TinyR1-32B-Preview-8bit

mlx-community/TinyR1-32B-Preview-8bit
Text generation · transformers
8-bit Open on Hugging Face
Parameters
33B
Weights (est.)
≈ 34.8 GB
Mac memory (est.)
48 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/TinyR1-32B-Preview-8bit --prompt "Hello"

Details

Base model
qihoo360/TinyR1-32B-Preview (quantized)
Vendor
qihoo360
Task
Text generation
Quantisation
8-bit
Licence
apache-2.0
Downloads
46 in the last 30 days · 321 all time · 0 likes
Published
2025-02-26 · updated 2025-02-26 (1y ago)
Tags
qwen2