GGUFs for Fireplace 34b - https://huggingface.co/ValiantLabs/Fireplace-34b

iMatrix GGUFs generated with Kalomaze's semi-random groups_merged.txt

Files >50gb have been split with peazip. Recombine with peazip, 7zip, or simple concatenate command.

Downloads last month
7
GGUF
Model size
34.4B params
Architecture
llama
Hardware compatibility
Log In to view the estimation
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for MarsupialAI/Fireplace-34b_iMatrix_GGUF

Quantized
(4)
this model