File size: 734 Bytes
d46b99d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
---
license: apache-2.0
---

## Model
OpenVINO Version 8bit of bce-embedding-base_v1. Using: https://huggingface.co/spaces/sentence-transformers/backend-export.
Calibrated using params: nyu-mll/glue, sst2, train, sentence, 300


## Inference

```python
from sentence_transformers import SentenceTransformer

# 1. Load the model from the Hugging Face Hub
model = SentenceTransformer(
    "guoch/bce-embedding-base_v1-openvino-qint8",
    backend="openvino",
    model_kwargs={"file_name": "openvino_model_qint8_quantized.xml"},
)

# 2. Inference works as normal
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
similarities = model.similarity(embeddings, embeddings)
```