Skip to content

AI21-Jamba-Reasoning-3B-bf16

mlx-community/AI21-Jamba-Reasoning-3B-bf16
bf16 Open on Hugging Face
Parameters
3.0B
Weights (est.)
≈ 6.1 GB
Mac memory (est.)
16 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/AI21-Jamba-Reasoning-3B-bf16 --prompt "Hello"

Details

Base model
ai21labs/AI21-Jamba-Reasoning-3B (finetune)
Vendor
AI21 · Jamba
Task
Text generation
Quantisation
bf16
Licence
apache-2.0
Downloads
65 in the last 30 days · 701 all time · 0 likes
Published
2025-10-14 · updated 2025-10-14 (1y ago)
Tags
jamba

Other MLX builds of ai21labs/AI21-Jamba-Reasoning-3B

Build Quantisation Weights Mac memory Downloads
AI21-Jamba-Reasoning-3B-4bit 4-bit ≈ 1.7 GB 8 GB+ 186
AI21-Jamba-Reasoning-3B-6bit 6-bit ≈ 2.5 GB 8 GB+ 50
AI21-Jamba-Reasoning-3B-bf16 (this one) bf16 ≈ 6.1 GB 16 GB+ 65