Skip to content

pandafish-dt-7b

mlx-community/pandafish-dt-7b
Uncategorised · mlx
Open on Hugging Face
Parameters
7.2B
Weights (est.)
≈ 28.7 GB
Mac memory (est.)
48 GB+

Size is estimated from the parameter count and quantisation. Memory allows a fifth extra for context plus 2 GB for the system; long contexts need more.

Details

Base model
CultriX/MergeCeption-7B-v3 (finetune)
Vendor
CultriX
Task
Uncategorised
Quantisation
Not stated
Licence
apache-2.0
Downloads
10 in the last 30 days · 172 all time · 1 likes
Published
2024-04-03 · updated 2024-04-04 (2y ago)
Tags
mistral, merge, mergekit, lazymergekit, CultriX/MergeCeption-7B-v3

Other MLX builds of CultriX/MergeCeption-7B-v3

Build Quantisation Weights Mac memory Downloads
pandafish-dt-7b-8bit 8-bit ≈ 4.0 GB 8 GB+ 16
pandafish-dt-7b (this one) — ≈ 28.7 GB 48 GB+ 10