Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-embeddings-inference

Misc with no match

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Models

77

Full-text search

Active filters: deepsparse

mgoin/TinyStories-1M-ds

Text Generation • Updated Dec 29, 2023 • 18

mgoin/TinyLlama-1.1B-step-50K-105b-ONNX

Text Generation • Updated Oct 5, 2023 • 12 • 1

RedHatAI/mpt-7b-chat-pruned50-quant-ds

Text Generation • Updated Oct 19, 2023 • 20 • 4

mgoin/mpt-7b-chat-quant

Text Generation • Updated Sep 20, 2023 • 18 • 1

mgoin/all-MiniLM-L6-v2-ds

Feature Extraction • Updated Sep 21, 2023 • 6

mgoin/open_llama_3b_v2-ds

Text Generation • Updated Oct 4, 2023 • 10

RedHatAI/bge-small-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 343 • 9

RedHatAI/mpt-7b-gsm8k-pruned50-quant-ds

Text Generation • Updated Oct 12, 2023 • 18

RedHatAI/bge-base-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 799 • 4

RedHatAI/bge-large-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 29.5k • 22

RedHatAI/mpt-7b-gsm8k-pruned40-quant-ds

Text Generation • Updated Oct 12, 2023 • 15

RedHatAI/mpt-7b-gsm8k-pruned60-quant-ds

Text Generation • Updated Oct 12, 2023 • 18

RedHatAI/mpt-7b-gsm8k-pruned70-quant-ds

Text Generation • Updated Oct 12, 2023 • 14 • 1

RedHatAI/mpt-7b-gsm8k-pruned80-quant-ds

Text Generation • Updated Oct 12, 2023 • 11 • 2

RedHatAI/mpt-7b-gsm8k-pruned75-quant-ds

Text Generation • Updated Oct 12, 2023 • 12

RedHatAI/mpt-7b-gsm8k-quant-ds

Text Generation • Updated Oct 18, 2023 • 12 • 1

mgoin/llama2.c-stories15M-ds

Text Generation • Updated Oct 18, 2023 • 22

mgoin/zephyr-7b-alpha-ds

Text Generation • Updated Oct 16, 2023 • 19 • 1

mgoin/Sheared-LLaMA-1.3B-ds

Text Generation • Updated Oct 19, 2023 • 23

mgoin/Nous-Hermes-llama-2-7b-ds

Text Generation • Updated Oct 25, 2023 • 14

RedHatAI/llama-2-7b-gsm8k-pruned60-quant-ds

Text Generation • Updated Oct 28, 2023

RedHatAI/zephyr-7b-beta-pruned50-quant-ds

Text Generation • Updated Jan 9, 2024 • 14

RedHatAI/TinyLlama-1.1B-Chat-v0.3-pruned50-quant-ds

Text Generation • Updated Nov 6, 2023

mgoin/deepseek-coder-1.3b-instruct-ds

Text Generation • Updated Nov 7, 2023 • 16

mgoin/deepseek-coder-1.3b-instruct-pruned50-quant-ds

Text Generation • Updated Nov 7, 2023 • 12

nm-testing/Yi-6B-Llama-50-quant

Text Generation • Updated Jan 2, 2024 • 9

RedHatAI/TinyLlama-1.1B-Chat-v0.4-pruned50-quant-ds

Text Generation • Updated Jan 29, 2024 • 15

RedHatAI/OpenHermes-2.5-Mistral-7B-pruned50-quant-ds

Text Generation • Updated Dec 6, 2023 • 18 • 2

mgoin/Orca-2-13b-pruned50-quant-ds

Text Generation • Updated Nov 26, 2023 • 10

nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant

Text Generation • Updated Jan 2, 2024 • 14