Spaces:

chansung
/

LLM-As-Chatbot

Runtime error

chansung commited on Mar 28, 2023

Commit

8cae68a

1 Parent(s): ce5c91f

Update gen.py

Files changed (1) hide show

gen.py CHANGED Viewed

@@ -71,7 +71,7 @@ class StreamModel:
         logprobs = max(logprobs, 0)
         # bigger than 1
-        chunk_size = 2
         chunk_count = 0
         # Generate completion tokens.

         logprobs = max(logprobs, 0)
         # bigger than 1
+        chunk_size = 5
         chunk_count = 0
         # Generate completion tokens.