Spaces:

rawkintrevo
/

hf-sme-test

Paused

rawkintrevo commited on Nov 6, 2023

Commit

0290441

1 Parent(s): f412023

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -12,7 +12,6 @@ model = AutoModelForCausalLM.from_pretrained(
   "rawkintrevo/hf-sme-falcon-7b",
   revision="v0.0.1",
   quantization_config=bnb_config,
-  # load_in_8bit=True,
   torch_dtype=torch.float16,
   trust_remote_code=True
 )

   "rawkintrevo/hf-sme-falcon-7b",
   revision="v0.0.1",
   quantization_config=bnb_config,
   torch_dtype=torch.float16,
   trust_remote_code=True
 )