Pygmalion 7B (q5_0 ggml version)
Converted from the XORed weights from PygmalionAI (i.e. ready for use).
Additionally, converted from bfloat16 to float16.
Additionally, converted from float16 to ggml float16.
Additionally, quantized from ggml float16 to ggml q5_0.
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model authors have turned it off explicitly.