Hugging Face's logo

CorticalStack
/
mistral-7b-openhermes-2.5-gptq

Text Generation
Transformers
Safetensors
mistral
text-generation-inference
4-bit precision
gptq
Model card Files Community
mistral-7b-openhermes-2.5-gptq / README.md
CorticalStack's picture
CorticalStack
Upload folder using huggingface_hub
6430f44 verified
preview code
|
raw
history blame contribute delete
773 Bytes
metadata
license: apache-2.0

CorticalStack/mistral-7b-openhermes-2.5-gptq

CorticalStack/mistral-7b-openhermes-2.5-gptq is an GPTQ quantised version of CorticalStack/mistral-7b-openhermes-2.5-sft.

GPTQ models are currently supported on Linux (NVidia/AMD) and Windows (NVidia only). MacOS users: please use GGUF models.

These GPTQ models are known to work in the following inference servers/webuis.