Crystalcareai
/

Quiet-Star-Custom

Text Generation

Model card Files Files and versions Community

Crystalcareai commited on Apr 5, 2024

Commit

0b3b65b

·

verified ·

1 Parent(s): 314f476

Update generate.py

Files changed (1) hide show

generate.py +2 -2

generate.py CHANGED Viewed

@@ -130,8 +130,8 @@ def generate(
     forced_eos_token_id= False,
     remove_invalid_values=None,
     synced_gpus=None,
-    n_ahead=4,
-    n_ahead_talk=4,
     merged_talk_heads=True,
     merged_lm_and_talk_heads=False,
     merged_lm_and_think_heads=True,

     forced_eos_token_id= False,
     remove_invalid_values=None,
     synced_gpus=None,
+    n_ahead=1,
+    n_ahead_talk=1,
     merged_talk_heads=True,
     merged_lm_and_talk_heads=False,
     merged_lm_and_think_heads=True,