infinity rerank inference

#3
by qdrddr - opened

Currently do not work

infinity_emb v2 --port 7997 \
  --model-id mixedbread-ai/mxbai-rerank-large-v2 --batch-size 8 --revision "refs/heads/main"

https://github.com/michaelfeil/infinity/issues/552

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment