Hugging Face's logo

gghfez
/
72B-Qwen2.5-Kunou-v1-control-vectors

GGUF
English
control-vector
creative-writing
Model card Files Community

gghfez/72B-Qwen2.5-Kunou-v1-control-vectors

Creative Writing control-vectors for Sao10K/72B-Qwen2.5-Kunou-v1

Usage example

llama.cpp 

llama-server --model  72B-Qwen2.5-Kunou-v1-Q4_K.gguf [other CLI arguments] \
    --control-vector  72B-Qwen2.5-Kunou-v1-character_focus__debias.gguf \
    --control-vector  72B-Qwen2.5-Kunou-v1-character_focus__dialogue.gguf \
    --control-vector  <other vectors>

Trained on 1xH100NVL using jukofyork's control-vectors

Based off Version v3.0 of creative-writing-control-vectors-v3.0.

See here for more info about control-vectors creative-writing-control-vectors-v3.0

Downloads last month
188
GGUF
Model size
647k params
Architecture
controlvector
View all files
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Collection including gghfez/72B-Qwen2.5-Kunou-v1-control-vectors