DavidAU commited on
Commit
f5e92bb
·
verified ·
1 Parent(s): b3479c7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -3
README.md CHANGED
@@ -782,15 +782,23 @@ Paper: https://arxiv.org/abs/2007.14966
782
 
783
  CRITICAL:
784
 
785
- If you activate Mirostat when using "LLAMAcpp SERVER" and/or some LLAMA_CPP based apps this will VOID/DISABLE all parameters (excluding "penalties" ) AND all other SAMPLERS except "temp" parameter plus the following:
786
 
787
  V1: n_vocab(model) (this is set internally by llamacpp), seed, mirostat_tau, mirostat_eta
788
 
789
  V2: seed, mirostat_tau, mirostat_eta
790
 
791
- It is unclear at this time if this occurs using Text Generation UI (and/or using LLAMACPP_HF loader), KoboldCPP or other customized LLM/AI app(s).
792
 
793
- ("seed" is usually a random value.)
 
 
 
 
 
 
 
 
794
 
795
 
796
  "mirostat-lr"
 
782
 
783
  CRITICAL:
784
 
785
+ If you activate Mirostat when using "LLAMAcpp SERVER" and/or some LLAMA_CPP based apps this will VOID/DISABLE all parameters (excluding "penalties", "logit_bias" ) AND all other SAMPLERS except "temp" parameter plus the following:
786
 
787
  V1: n_vocab(model) (this is set internally by llamacpp), seed, mirostat_tau, mirostat_eta
788
 
789
  V2: seed, mirostat_tau, mirostat_eta
790
 
791
+ For Koboldcpp:
792
 
793
+ "DRY" sampling is NOT blocked, and a version of "top_k" (3000) is used (but Mirostat does NOT block "Anti-Slop" , BUT does block "penalities" parameters (unlike Llamacpp - which does not) ).
794
+
795
+ For Text Generation UI:
796
+
797
+ No blocking occurs. Note that ONLY Mirostat 2 is available. (other parameters/samplers should work without issue)
798
+
799
+ Note this is subject to change by LLAMAcpp, Koboldcpp, Text Generation UI and other AI/LLM app makers at any time.
800
+
801
+ ("seed" is usually a random value. (default) ; this parameter can be set in some AI/LLM apps to control Mirostat output more closely.)
802
 
803
 
804
  "mirostat-lr"