Spaces:

skaltenp
/

WorkshopSpring2024

Paused

skaltenp commited on Mar 23, 2024

Commit

9affd7f

verified ·

1 Parent(s): 28ffec1

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -11,7 +11,7 @@ bnb_config = BitsAndBytesConfig(
 base_model = AutoModelForCausalLM.from_pretrained(
     model_name,
     quantization_config=bnb_config,
-    device_map="auto",
     trust_remote_code=True,
     #token=True,
 )

 base_model = AutoModelForCausalLM.from_pretrained(
     model_name,
     quantization_config=bnb_config,
+    device_map="cuda:0",
     trust_remote_code=True,
     #token=True,
 )