Skip to content

Llama-3_3-Nemotron-Super-49B-v1_5-mlx-4Bit

mlx-community/Llama-3_3-Nemotron-Super-49B-v1_5-mlx-4Bit
Text generation · transformers
4-bit Open on Hugging Face
Parameters
50B
Weights (est.)
≈ 28.1 GB
Mac memory (est.)
48 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Llama-3_3-Nemotron-Super-49B-v1_5-mlx-4Bit --prompt "Hello"

Details

Base model
unsloth/Llama-3_3-Nemotron-Super-49B-v1_5 (quantized)
Vendor
unsloth
Task
Text generation
Quantisation
4-bit
Licence
nvidia-open-model-license
Downloads
163 in the last 30 days · 5.1K all time · 3 likes
Published
2025-09-15 · updated 2025-09-15 (1y ago)
Languages
en
Tags
nemotron-nas, nvidia, unsloth - llama-3 - pytorch, mlx-my-repo, custom_code