Final_Assignment_Template

Sleeping

Thomas Bartlett commited on May 12

Commit

96bb8bb

1 Parent(s): 50fe614

back to hf inference

Files changed (1) hide show

app.py CHANGED Viewed

@@ -68,7 +68,7 @@ class BasicAgent:
                 max_new_tokens=512,
                 temperature=0.0,
                 do_sample=False,
-                provider="auto"  # Automatically select the first available provider
             )
         )

                 max_new_tokens=512,
                 temperature=0.0,
                 do_sample=False,
+                provider="hf-inference"  # Automatically select the first available provider
             )
         )