Thomas Bartlett commited on
Commit
f40113b
·
1 Parent(s): 744fb46

fix the inference provider

Browse files
Files changed (1) hide show
  1. app.py +2 -0
app.py CHANGED
@@ -67,6 +67,8 @@ class BasicAgent:
67
  max_new_tokens=512,
68
  temperature=0.0,
69
  do_sample=False,
 
 
70
  )
71
  )
72
 
 
67
  max_new_tokens=512,
68
  temperature=0.0,
69
  do_sample=False,
70
+ provider="auto" # Automatically select the first available provider
71
+
72
  )
73
  )
74