Parameters

#9
by Fujiao - opened

Hello,

Thanks for your great work! I am wondering how we can change the parameters, like temperature, top p, top k, etc. There is only do_sample=False. Thanks

Hey @Fujiao , you can add the parameters when calling the 'model.generate()' function like this:

model.generate(**inputs, do_sample=False, max_new_tokens=100, temperature=0, top_p=0, top_k=0)

Hope that solves your question!

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment