Spaces:

togethercomputer
/

GPT-JT

Runtime error

juewang commited on Nov 25, 2022

Commit

7f5cbab

1 Parent(s): 0c8c7dc

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -2,6 +2,7 @@ import streamlit as st
 import requests
 import time
 def infer(prompt,
           model_name,
           max_new_tokens=10,

 import requests
 import time
+@st.cache
 def infer(prompt,
           model_name,
           max_new_tokens=10,