Spaces:

Aneeth
/

zephyr_infererence

Sleeping

Aneeth commited on Jan 20, 2024

Commit

9473c22

verified ·

1 Parent(s): ec6df95

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -21,7 +21,7 @@ model = AutoPeftModelForCausalLM.from_pretrained(
     device_map="auto",
     trust_remote_code=True
     )
 tokenizer = AutoTokenizer.from_pretrained("Aneeth/zephyr_10k")
 generation_config = GenerationConfig(
     do_sample=True,

     device_map="auto",
     trust_remote_code=True
     )
+model.tie_weights()
 tokenizer = AutoTokenizer.from_pretrained("Aneeth/zephyr_10k")
 generation_config = GenerationConfig(
     do_sample=True,