Spaces:

bhaskartripathi
/

pdfChatterSandbox

Runtime error

bhaskartripathi commited on Mar 21, 2023

Commit

9003005

1 Parent(s): 1609ef2

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -25,8 +25,8 @@ model = LlamaForCausalLM.from_pretrained(
     "decapoda-research/llama-7b-hf",
     # load_in_8bit=True,
     # torch_dtype=torch.float16,
-    device_map="auto",
-    # device_map={"":"cpu"},
     max_memory={"cpu":"15GiB"},
     quantization_config=quantization_config
 )

     "decapoda-research/llama-7b-hf",
     # load_in_8bit=True,
     # torch_dtype=torch.float16,
+    #device_map="auto",
+    device_map={"":"cpu"},
     max_memory={"cpu":"15GiB"},
     quantization_config=quantization_config
 )