Hugging Face's logo

Spaces:
hoduyquocbao
/
LLAMA3.2-GRop
Sleeping

App Files Community
hoduyquocbao commited on
Commit
c3f15f3
·
1 Parent(s): 4bf04ee

fix device_map

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -19,7 +19,7 @@ tokenizer = AutoTokenizer.from_pretrained(MODEL_ID)
19
  model = AutoModelForCausalLM.from_pretrained(
20
  MODEL_ID,
21
  torch_dtype=torch.float16,
22
- device_map="cuda",
23
  low_cpu_mem_usage=True
24
  ).eval()
25
 
 
19
  model = AutoModelForCausalLM.from_pretrained(
20
  MODEL_ID,
21
  torch_dtype=torch.float16,
22
+ device_map="auto",
23
  low_cpu_mem_usage=True
24
  ).eval()
25