NVIDIA-Nemotron-3.5-Bolt-E4B-OptiQ-4bit

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-vlm on an Apple silicon Mac:

pip install mlx-vlmpython -m mlx_vlm.generate --model mlx-community/NVIDIA-Nemotron-3.5-Bolt-E4B-OptiQ-4bit --image photo.jpg --prompt "Describe this image"

Details

Base model

nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16 (quantized) · NVIDIA Nemotron 3.5 Bolt E4B BF16 on the radar →

Vendor

NVIDIA

Task

Vision + text

Quantisation

4-bit

Licence

openmdw-1.1

Downloads

3.2K in the last 30 days · 3.2K all time · 8 likes

Published

2026-10-24 · updated 2026-10-24 (18d ago)

Languages

en, ar, bg, cs, da, de, el, es, et, fi, fr, hi, hr, hu, id, it, ja, ko, lt, lv, nl, no, pl, pt, ro, ru, sk, sl, sv, th, tr, uk, vi, zh

Tags

gemma4, optiq, quantized, mixed-precision, 4bit, 8bit, nemotron, gemma-4, vision-language-model, apple-silicon