Parameters
#9
by
Fujiao
- opened
Hello,
Thanks for your great work! I am wondering how we can change the parameters, like temperature, top p, top k, etc. There is only do_sample=False. Thanks
Hey @Fujiao , you can add the parameters when calling the 'model.generate()' function like this:
model.generate(**inputs, do_sample=False, max_new_tokens=100, temperature=0, top_p=0, top_k=0)
Hope that solves your question!