RedHatAI
/

bge-small-en-v1.5-sparse

Feature Extraction

sparse sparsity quantized onnx embeddings int8

text-embeddings-inference

Model card Files Files and versions

zeroshot commited on Nov 13, 2023

Commit

f7fad3b

·

1 Parent(s): dadd317

Update README.md

Files changed (1) hide show

README.md +1 -4

README.md CHANGED Viewed

@@ -1627,12 +1627,9 @@ Current list of sparse and quantized bge ONNX models:
 | Links                                                                                               | Sparsification Method |
 | --------------------------------------------------------------------------------------------------- | ---------------------- |
-| [zeroshot/bge-large-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-large-en-v1.5-sparse)     |    Quantization (INT8) & 50% Pruning                    |
-| [zeroshot/bge-large-en-v1.5-quant](https://huggingface.co/zeroshot/bge-large-en-v1.5-quant)     |   Quantization (INT8)                     |
 | [zeroshot/bge-base-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-base-en-v1.5-sparse)     |   Quantization (INT8) & 50% Pruning                     |
-| [zeroshot/bge-base-en-v1.5-quant](https://huggingface.co/zeroshot/bge-base-en-v1.5-quant)     |     Quantization (INT8)                    |
 | [zeroshot/bge-small-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-small-en-v1.5-sparse) |    Quantization (INT8) & 50% Pruning                    |
-| [zeroshot/bge-small-en-v1.5-quant](https://huggingface.co/zeroshot/bge-small-en-v1.5-quant) |     Quantization (INT8)                    |
 ```bash
 pip install -U deepsparse-nightly[sentence_transformers]

 | Links                                                                                               | Sparsification Method |
 | --------------------------------------------------------------------------------------------------- | ---------------------- |
+| [zeroshot/bge-large-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-large-en-v1.5-sparse)     |    Quantization (INT8) & 50% Pruning                    |               |
 | [zeroshot/bge-base-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-base-en-v1.5-sparse)     |   Quantization (INT8) & 50% Pruning                     |
 | [zeroshot/bge-small-en-v1.5-sparse](https://huggingface.co/zeroshot/bge-small-en-v1.5-sparse) |    Quantization (INT8) & 50% Pruning                    |
 ```bash
 pip install -U deepsparse-nightly[sentence_transformers]