infinity rerank inference
#3
by
qdrddr
- opened
Currently do not work
infinity_emb v2 --port 7997 \
--model-id mixedbread-ai/mxbai-rerank-large-v2 --batch-size 8 --revision "refs/heads/main"
looping in @michaelfeil
We chatted already discussion how to do this in the issue above.
aamirshakir
changed discussion status to
closed