Spaces:

Daemontatox
/

Mawared-Support-Assistant

Runtime error

vilarin commited on Jul 23, 2024

Commit

6b67af9

verified ·

1 Parent(s): b179e70

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -38,7 +38,8 @@ model = AutoModelForCausalLM.from_pretrained(
     MODEL,
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
-    device_map="auto")
 @spaces.GPU()
 def stream_chat(

     MODEL,
     torch_dtype=torch.bfloat16,
     low_cpu_mem_usage=True,
+    device_map="auto",
+    trust_remote_code=True)
 @spaces.GPU()
 def stream_chat(