gghfez/Sorcerer_creative-writing-control-vectors

Creative Writing control-vectors for rAIfle/SorcererLM-8x22b-bf16

This is an excellent model, but I found it somewhat diffcult to steer via prompting.

These control vector solved it for me.

Usage example

llama-server --model SorcererLM-8x22b-iMat-IQ4_XS-00001-of-00002.gguf [other CLI arguments] \
    --control-vector  SorcererLM-8x22b-optimism_vs_nihilism__debias.gguf \
    --control-vector  <add as many as you want like this>.gguf

Train on 1xH100NVL using jukofyork's control-vectors

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0

Downloads last month
125
GGUF
Model size
338k params
Architecture
controlvector
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including gghfez/Sorcerer_creative-writing-control-vectors