Hugging Face's logo

Kooten
/
Noromaid-7B-0.4-DPO-8bpw-exl2

Text Generation
Transformers
Safetensors
mistral
text-generation-inference
Inference Endpoints
Model card Files Community

Noromaid-7B-0.4-DPO 8bpw EXL2

Description

Exllama quant of NeverSleep/Noromaid-7B-0.4-DPO

Other quants:

EXL2: 8bpw, 6bpw, 4bpw

Prompt format: Chatml 

<|im_start|>system
{sysprompt}<|im_end|>
<|im_start|>user
{input}<|im_end|>
<|im_start|>assistant
{output}<|im_end|>

Contact

Kooten on discord

Downloads last month
16
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.