Spaces:

KantaHayashiAI
/

EvaByte-SFT

Sleeping

KantaHayashiAI commited on Apr 30

Commit

85ab2f8

verified ·

1 Parent(s): d95a718

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -46,7 +46,7 @@ def generate(
     streamer = TextIteratorStreamer(tokenizer, timeout=20.0, skip_prompt=True, skip_special_tokens=True)
     generate_kwargs = dict(
         {"input_ids": input_ids},
-        streamer=streamer,
         max_new_tokens=max_new_tokens,
         do_sample=True,
         top_p=top_p,

     streamer = TextIteratorStreamer(tokenizer, timeout=20.0, skip_prompt=True, skip_special_tokens=True)
     generate_kwargs = dict(
         {"input_ids": input_ids},
+        #streamer=streamer,
         max_new_tokens=max_new_tokens,
         do_sample=True,
         top_p=top_p,