Spaces:

huggingchat
/

chat-ui

Running

nsarrazin commited on Jan 17, 2024

Commit

9b5d65a

unverified ·

1 Parent(s): 01418cd

Bump max new tokens for NousResearch/Nous-Hermes-2-Mixtral-8x7B-DPO (#702)

Files changed (1) hide show

.env.template CHANGED Viewed

@@ -82,8 +82,8 @@ MODELS=`[
         "top_p": 0.95,
         "repetition_penalty": 1,
         "top_k": 50,
-        "truncate": 3072,
-        "max_new_tokens": 512,
         "stop": ["<|im_end|>"]
       }
     },

         "top_p": 0.95,
         "repetition_penalty": 1,
         "top_k": 50,
+        "truncate": 24576,
+        "max_new_tokens": 2048,
         "stop": ["<|im_end|>"]
       }
     },