Final_Assignment_Template

Sleeping

Thomas Bartlett commited on May 12

Commit

9b20450

1 Parent(s): 3878af4

set it to hf inference

Files changed (1) hide show

app.py CHANGED Viewed

@@ -67,7 +67,7 @@ class BasicAgent:
                 max_new_tokens=512,
                 temperature=0.0,
                 do_sample=False,
-                provider="auto"  # Automatically select the first available provider
             )
         )

                 max_new_tokens=512,
                 temperature=0.0,
                 do_sample=False,
+                provider="hf-inference"  # Automatically select the first available provider
             )
         )