Skip to content

NemotronLabs-VoiceChat-11B-4bit

mlx-community/NemotronLabs-VoiceChat-11B-4bit
Uncategorised · mlx
4-bit Open on Hugging Face
Parameters
11B
Weights (est.)
≈ 8.6 GB
Mac memory (est.)
16 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
nvidia/NVIDIA-NemotronLabs-VoiceChat-11B (quantized)
Vendor
NVIDIA
Task
Uncategorised
Quantisation
4-bit
Licence
openmdw-1.1
Downloads
415 in the last 30 days · 1.3K all time · 8 likes
Published
2026-08-08 · updated 2026-08-08 (3mo ago)
Languages
en
Tags
nemotron_voicechat, tool-use, multimodal

Other MLX builds of nvidia/NVIDIA-NemotronLabs-VoiceChat-11B

Build Quantisation Weights Mac memory Downloads
NemotronLabs-VoiceChat-11B-mlx-4bit 4-bit ≈ 5.1 GB 8 GB+ 52
NemotronLabs-VoiceChat-11B-mlx-8bit 8-bit ≈ 6.9 GB 16 GB+ 77
NemotronLabs-VoiceChat-11B-4bit (this one) 4-bit ≈ 8.6 GB 16 GB+ 415
NemotronLabs-VoiceChat-11B-8bit 8-bit ≈ 13.3 GB 24 GB+ 485
NemotronLabs-VoiceChat-11B-mlx-bf16 bf16 ≈ 22.2 GB 32 GB+ 43
NemotronLabs-VoiceChat-11B-bf16 bf16 ≈ 22.2 GB 32 GB+ 36