parameters guide
samplers guide
model generation
role play settings
quant selection
arm quants
iq quants vs q quants
optimal model setting
gibberish fixes
coherence
instructing following
quality generation
chat settings
quality settings
llamacpp server
llamacpp
lmstudio
sillytavern
koboldcpp
backyard
ollama
model generation steering
steering
model generation fixes
text generation webui
ggufs
exl2
full precision
quants
imatrix
neo imatrix
Update README.md
Browse files
README.md
CHANGED
@@ -782,15 +782,23 @@ Paper: https://arxiv.org/abs/2007.14966
|
|
782 |
|
783 |
CRITICAL:
|
784 |
|
785 |
-
If you activate Mirostat when using "LLAMAcpp SERVER" and/or some LLAMA_CPP based apps this will VOID/DISABLE all parameters (excluding "penalties" ) AND all other SAMPLERS except "temp" parameter plus the following:
|
786 |
|
787 |
V1: n_vocab(model) (this is set internally by llamacpp), seed, mirostat_tau, mirostat_eta
|
788 |
|
789 |
V2: seed, mirostat_tau, mirostat_eta
|
790 |
|
791 |
-
|
792 |
|
793 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
794 |
|
795 |
|
796 |
"mirostat-lr"
|
|
|
782 |
|
783 |
CRITICAL:
|
784 |
|
785 |
+
If you activate Mirostat when using "LLAMAcpp SERVER" and/or some LLAMA_CPP based apps this will VOID/DISABLE all parameters (excluding "penalties", "logit_bias" ) AND all other SAMPLERS except "temp" parameter plus the following:
|
786 |
|
787 |
V1: n_vocab(model) (this is set internally by llamacpp), seed, mirostat_tau, mirostat_eta
|
788 |
|
789 |
V2: seed, mirostat_tau, mirostat_eta
|
790 |
|
791 |
+
For Koboldcpp:
|
792 |
|
793 |
+
"DRY" sampling is NOT blocked, and a version of "top_k" (3000) is used (but Mirostat does NOT block "Anti-Slop" , BUT does block "penalities" parameters (unlike Llamacpp - which does not) ).
|
794 |
+
|
795 |
+
For Text Generation UI:
|
796 |
+
|
797 |
+
No blocking occurs. Note that ONLY Mirostat 2 is available. (other parameters/samplers should work without issue)
|
798 |
+
|
799 |
+
Note this is subject to change by LLAMAcpp, Koboldcpp, Text Generation UI and other AI/LLM app makers at any time.
|
800 |
+
|
801 |
+
("seed" is usually a random value. (default) ; this parameter can be set in some AI/LLM apps to control Mirostat output more closely.)
|
802 |
|
803 |
|
804 |
"mirostat-lr"
|