Spaces:

rasyosef
/

phi-2-chat

Running

rasyosef commited on Jan 6, 2024

Commit

a5adcb7

1 Parent(s): a5d8bbc

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -26,7 +26,7 @@ def generate(prompt, chat_history):
   final_prompt += "User: " + prompt + "\n"
   final_prompt += "Output:"
-  generated_text = phi2(final_prompt, max_length=128)[0]["generated_text"]
   response = generated_text.split("Output:")[1].split("User:")[0]
   if "Assistant:" in response:

   final_prompt += "User: " + prompt + "\n"
   final_prompt += "Output:"
+  generated_text = phi2(final_prompt, max_new_tokens=16)[0]["generated_text"]
   response = generated_text.split("Output:")[1].split("User:")[0]
   if "Assistant:" in response: