AWQ quant of jukofyork/creative-writer-35b-preview

Original Readme:

An experimental model, fine-tuned using the "multiplicative-LoRA" method on command-r-v01.

NOTE: You MUST use some (small) value of min-p with this such as 0.01 (as with the original command-r-v01 model), or else the model will output gibberish!

Downloads last month
9
Safetensors
Model size
6.5B params
Tensor type
I32
·
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Model tree for gghfez/jukofyork_creative-writer-35b-preview-AWQ

Quantized
(4)
this model