how to use fp16 for faster inference?

#4
by imduckman - opened

and how to optimize batch size

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment