Skip to content

Mistral7B-PairRM-SPPO-Iter3-unquantized

mlx-community/Mistral7B-PairRM-SPPO-Iter3-unquantized
Open on Hugging Face
Parameters
7.2B
Weights (est.)
≈ 14.5 GB
Mac memory (est.)
24 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Run it

With mlx-lm on an Apple silicon Mac:

pip install mlx-lmmlx_lm.generate --model mlx-community/Mistral7B-PairRM-SPPO-Iter3-unquantized --prompt "Hello"

Details

Base model
—
Vendor
—
Task
Text generation
Quantisation
Not stated
Licence
apache-2.0
Downloads
66 in the last 30 days · 492 all time · 1 likes
Published
2024-05-07 · updated 2024-05-07 (2y ago)
Languages
en
Tags
mistral