Skip to content

Llama-SEA-LION-v3-8B-IT-mlx-4bit

mlx-community/Llama-SEA-LION-v3-8B-IT-mlx-4bit
Text generation · transformers
4-bit Open on Hugging Face
Parameters
1.5B
Weights (est.)
≈ 1.6 GB
Mac memory (est.)
8 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Llama-SEA-LION-v3-8B-IT-mlx-4bit --prompt "Hello"

Details

Base model
aisingapore/Llama-SEA-LION-v3-8B (finetune)
Vendor
aisingapore
Task
Text generation
Quantisation
4-bit
Licence
llama3.1
Downloads
27 in the last 30 days · 152 all time · 0 likes
Published
2025-09-10 · updated 2025-09-10 (1y ago)
Languages
en, zh, vi, id, th, fil, ta, ms, km, lo, my, jv, su
Tags
llama