File size: 734 Bytes
d46b99d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 |
---
license: apache-2.0
---
## Model
OpenVINO Version 8bit of bce-embedding-base_v1. Using: https://huggingface.co/spaces/sentence-transformers/backend-export.
Calibrated using params: nyu-mll/glue, sst2, train, sentence, 300
## Inference
```python
from sentence_transformers import SentenceTransformer
# 1. Load the model from the Hugging Face Hub
model = SentenceTransformer(
"guoch/bce-embedding-base_v1-openvino-qint8",
backend="openvino",
model_kwargs={"file_name": "openvino_model_qint8_quantized.xml"},
)
# 2. Inference works as normal
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
similarities = model.similarity(embeddings, embeddings)
``` |