blossom-v5.1-34b

ExLlamav2 8 bpw quant of https://huggingface.co/Azure99/blossom-v5.1-34b

Downloads last month
4
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model authors have turned it off explicitly.

Model tree for altomek/blossom-v5.1-34b-8bpw-EXL2

Quantized
(4)
this model

Datasets used to train altomek/blossom-v5.1-34b-8bpw-EXL2