YuE-music-generator-demo-zero

Paused

KingNish commited on Jan 30

Commit

9aa37e5

verified ·

1 Parent(s): f28f98c

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -81,8 +81,8 @@ model = AutoModelForCausalLM.from_pretrained(
     torch_dtype="auto",
     attn_implementation="flash_attention_2",
     quantization_config=quantization_config,
-    low_cpu_mem_usage=True,
-    device_map="auto"
 ).to(device)
 model.eval()

     torch_dtype="auto",
     attn_implementation="flash_attention_2",
     quantization_config=quantization_config,
+    # low_cpu_mem_usage=True,
+    # device_map="auto"
 ).to(device)
 model.eval()