Spaces:

almncarlo
/

myalexa

Runtime error

almncarlo commited on May 4, 2024

Commit

40def4b

verified ·

1 Parent(s): a4c3e3f

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -44,7 +44,7 @@ amp_dtype = torch.float16
 llm_model = transformers.AutoModelForCausalLM.from_pretrained(
     "microsoft/Phi-3-mini-128k-instruct",
-    device_map="cuda",
     torch_dtype="auto",
     trust_remote_code=True,
 )

 llm_model = transformers.AutoModelForCausalLM.from_pretrained(
     "microsoft/Phi-3-mini-128k-instruct",
+    device_map="auto",
     torch_dtype="auto",
     trust_remote_code=True,
 )