Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

Inference Endpoints

text-embeddings-inference

Misc with no match

text-generation-inference

4-bit precision

8-bit precision

Carbon Emissions

Mixture of Experts

Models

75

Full-text search

Active filters: deepsparse

mgoin/TinyStories-1M-ds

Text Generation • Updated Dec 29, 2023 • 7

mgoin/TinyLlama-1.1B-step-50K-105b-ONNX

Text Generation • Updated Oct 5, 2023 • 6 • 1

RedHatAI/mpt-7b-chat-pruned50-quant-ds

Text Generation • Updated Oct 19, 2023 • 12 • 4

mgoin/mpt-7b-chat-quant

Text Generation • Updated Sep 20, 2023 • 8 • 1

mgoin/all-MiniLM-L6-v2-ds

Feature Extraction • Updated Sep 21, 2023 • 2

mgoin/open_llama_3b_v2-ds

Text Generation • Updated Oct 4, 2023 • 1

RedHatAI/bge-small-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 687 • 9

RedHatAI/mpt-7b-gsm8k-pruned50-quant-ds

Text Generation • Updated Oct 12, 2023 • 3

RedHatAI/bge-base-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 476 • 4

RedHatAI/bge-large-en-v1.5-quant

Feature Extraction • Updated Nov 13, 2023 • 39k • 21

RedHatAI/mpt-7b-gsm8k-pruned40-quant-ds

Text Generation • Updated Oct 12, 2023 • 3

RedHatAI/mpt-7b-gsm8k-pruned60-quant-ds

Text Generation • Updated Oct 12, 2023 • 1

RedHatAI/mpt-7b-gsm8k-pruned70-quant-ds

Text Generation • Updated Oct 12, 2023 • 2 • 1

RedHatAI/mpt-7b-gsm8k-pruned80-quant-ds

Text Generation • Updated Oct 12, 2023 • 2 • 2

RedHatAI/mpt-7b-gsm8k-pruned75-quant-ds

Text Generation • Updated Oct 12, 2023

RedHatAI/mpt-7b-gsm8k-quant-ds

Text Generation • Updated Oct 18, 2023 • 4 • 1

mgoin/llama2.c-stories15M-ds

Text Generation • Updated Oct 18, 2023 • 1

mgoin/zephyr-7b-alpha-ds

Text Generation • Updated Oct 16, 2023 • 5 • 1

mgoin/Sheared-LLaMA-1.3B-ds

Text Generation • Updated Oct 19, 2023 • 2

mgoin/Nous-Hermes-llama-2-7b-ds

Text Generation • Updated Oct 25, 2023

RedHatAI/zephyr-7b-beta-pruned50-quant-ds

Text Generation • Updated Jan 9, 2024 • 1

mgoin/deepseek-coder-1.3b-instruct-ds

Text Generation • Updated Nov 7, 2023 • 4

mgoin/deepseek-coder-1.3b-instruct-pruned50-quant-ds

Text Generation • Updated Nov 7, 2023 • 11

nm-testing/Yi-6B-Llama-50-quant

Text Generation • Updated Jan 2, 2024

RedHatAI/TinyLlama-1.1B-Chat-v0.4-pruned50-quant-ds

Text Generation • Updated Jan 29, 2024 • 12

RedHatAI/OpenHermes-2.5-Mistral-7B-pruned50-quant-ds

Text Generation • Updated Dec 6, 2023 • 6 • 2

mgoin/Orca-2-13b-pruned50-quant-ds

Text Generation • Updated Nov 26, 2023 • 7

nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant

Text Generation • Updated Jan 2, 2024

RedHatAI/MiniChat-3B-pruned50-quant-ds

Text Generation • Updated Jan 2, 2024 • 3

nm-testing/open_llama_3b-pruned50-quant-ds

Text Generation • Updated Jan 11, 2024