Issue of NaN values when running predict on CPU

#6
by himj98 - opened

When forcing the model to run on cpu on a MacBook M2, we get NaN values when running the predict function. Note that when we use the default device = 'mps' we get the required response correctly. Also this happens only for the ms-marco-miniLM-L-6-v2, note that for ms-marco-miniLM-L-12-v2 we get the right responses too.

image.png

image.png

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment