Spaces:

nazimali
/

Mistral-Nemo-Kurdish-Instruct

Running on Zero

nazimali commited on Jan 12

Commit

7e15cf4

verified ·

1 Parent(s): 4d44371

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -52,7 +52,7 @@ def respond(
         return_tensors="pt",
         add_special_tokens=False,
         return_token_type_ids=False,
-    ).to("cuda")
     with torch.inference_mode():
         generated_ids = model.generate(

         return_tensors="pt",
         add_special_tokens=False,
         return_token_type_ids=False,
+    )
     with torch.inference_mode():
         generated_ids = model.generate(