Hugging Face's logo

Spaces:
Abhinav7
/
trial1
Sleeping

App Files Community
Abhinav7 commited on
Commit
2d88192
·
verified ·
1 Parent(s): fa0a27b

Update main.py

Browse files
Files changed (1) hide show
  1. main.py +1 -1
main.py CHANGED
@@ -6,7 +6,7 @@ from ctransformers import AutoModelForCausalLM
6
  #Model loading
7
  llm = AutoModelForCausalLM.from_pretrained("zephyr-7b-beta.Q4_K_S.gguf",
8
  model_type='mistral',
9
- max_new_tokens = 1096,
10
  threads = 3,
11
  )
12
 
 
6
  #Model loading
7
  llm = AutoModelForCausalLM.from_pretrained("zephyr-7b-beta.Q4_K_S.gguf",
8
  model_type='mistral',
9
+ max_new_tokens = 256,
10
  threads = 3,
11
  )
12