Spaces:

Aneeth
/

zephyr_infererence

Sleeping

Aneeth commited on Jan 20, 2024

Commit

45bb491

verified ·

1 Parent(s): 929735b

Update app.py

Files changed (1) hide show

app.py CHANGED Viewed

@@ -1,6 +1,6 @@
 from peft import AutoPeftModelForCausalLM
 from transformers import GenerationConfig
-from transformers import AutoTokenizer
 import torch
 import streamlit as st

 from peft import AutoPeftModelForCausalLM
 from transformers import GenerationConfig
+from transformers import AutoTokenizer, GPTQConfig
 import torch
 import streamlit as st