README.md

metadata

tags:
  - sparse sparsity quantized onnx embeddings int8
license: mit
language:
  - en

gte-large-large

This is the quantized (INT8) ONNX variant of the gte-large embeddings model created with DeepSparse Optimum for ONNX export/inference and Neural Magic's Sparsify for one-shot quantization.

Current list of sparse and quantized gte ONNX models:

Links	Sparsification Method
zeroshot/gte-large-sparse	Quantization (INT8) & 50% Pruning
zeroshot/gte-large-quant	Quantization (INT8)
zeroshot/gte-base-sparse	Quantization (INT8) & 50% Pruning
zeroshot/gte-base-quant	Quantization (INT8)
zeroshot/gte-small-sparse	Quantization (INT8) & 50% Pruning
zeroshot/gte-small-quant	Quantization (INT8)

For general questions on these models and sparsification methods, reach out to the engineering team on our community Slack.