Spaces:

showlab
/

ShowUI

Running on Zero

KevinQHLin commited on Jan 24

Commit

1459106

verified ·

1 Parent(s): bb6012f

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -54,7 +54,7 @@ for file in files:
 model = Qwen2VLForConditionalGeneration.from_pretrained(
     destination_folder,
     torch_dtype=torch.bfloat16,
-    # device_map="cpu",
     attn_implementation = "flash_attention_2",
 )

 model = Qwen2VLForConditionalGeneration.from_pretrained(
     destination_folder,
     torch_dtype=torch.bfloat16,
+    device_map="cpu",
     attn_implementation = "flash_attention_2",
 )