salamandra-7b-instruct-mlx-bf16

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/salamandra-7b-instruct-mlx-bf16 --prompt "Hello"

Details

Base model

BSC-LT/salamandra-7b-instruct (finetune)

Vendor

BSC-LT

Task

Text generation

Quantisation

bf16

Licence

apache-2.0

Downloads

35 in the last 30 days · 287 all time · 1 likes

Published

2025-07-22 · updated 2025-08-21 (1y ago)

Languages

bg, ca, code, cs, cy, da, de, el, en, es, et, eu, fi, fr, ga, gl, hr, hu, it, lt, lv, mt, nl, nn, \no, oc, pl, pt, ro, ru, sh, sk, sl, sr, sv, uk

Tags

llama