Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

Inference Endpoints

text-embeddings-inference

Misc with no match

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Models

75

Full-text search

Active filters: deepsparse

nm-testing/TinyLlama-1.1B-Chat-v1.0-pruned50-quant-ds-v2

Text Generation • Updated Jan 18, 2024 • 12

nm-testing/openchat-3.5-0106-pruned50-quant-ds

Text Generation • Updated Jan 19, 2024 • 13

nm-testing/TinyLlama-1.1B-Chat-v1.0-open_platypus-pruned50-quant-ds

Updated Jan 23, 2024

nm-testing/TinyLlama-1.1B-intermediate-step-1431k-3T-gsms8k-pruned50-quant-ds

Text Generation • Updated Jan 26, 2024 • 19

nm-testing/llama2-7b-gsm8k-pt-pruned50-quant-ds

Text Generation • Updated Feb 2, 2024 • 14

neuralmagic/Llama-2-7b-ultrachat200k-pruned_50-quantized-deepsparse

Text Generation • Updated May 7, 2024 • 21

neuralmagic/Llama-2-7b-ultrachat200k-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 25

neuralmagic/Llama-2-7b-evol-code-alpaca-pruned_50-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 29

neuralmagic/Llama-2-7b-evol-code-alpaca-pruned_70-quantized-deepsparse

Text Generation • Updated May 15, 2024 • 22

neuralmagic/Llama-2-7b-dolphin-open_platypus-pruned_50-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 26

neuralmagic/Llama-2-7b-dolphin-open_platypus-pruned_70-quantized-deepsparse

Text Generation • Updated May 16, 2024 • 23 • 1

nm-testing/granite-7b-lab-pruned50-quant-ds

Text Generation • Updated May 1, 2024 • 10

mgoin/Meta-Llama-3-8B-Instruct-pruned50-quant-ds

Text Generation • Updated Jun 28, 2024 • 19

nm-testing/mobilenet_v1-1.0_pytorch_sparseml_imagenet_pruned-moderate

Updated Nov 5, 2024

nm-testing/yolov8-m_pytorch_ultralytics_voc_pruned80_quant-none

Updated Nov 5, 2024