Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2210.17323

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Mixture of Experts

Models

156

Full-text search

Active filters: 2210.17323

neuralmagic/Llama-2-7b-chat-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 523 • 1

neuralmagic/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 28.9k • 2

neuralmagic/Qwen2-1.5B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 1.31k

neuralmagic/Qwen2-0.5B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 275

neuralmagic/Phi-3-medium-128k-instruct-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 5.45k • 3

neuralmagic/Qwen2-7B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 430

neuralmagic/Meta-Llama-3-70B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 17

neuralmagic/Qwen2-72B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 39 • 1

rinna/llama-3-youko-8b-gptq

Text Generation • Updated Aug 31, 2024 • 20

rinna/llama-3-youko-8b-instruct-gptq

Text Generation • Updated Aug 31, 2024 • 32 • 1

rinna/llama-3-youko-70b-gptq

Text Generation • Updated Aug 31, 2024 • 9

rinna/llama-3-youko-70b-instruct-gptq

Text Generation • Updated Aug 31, 2024 • 8

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a16

Text Generation • Updated Oct 23, 2024 • 4.93k • 9

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 156 • 4

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Feb 11 • 3.55k • 19

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 190 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 1.27k • 2

neuralmagic/starcoder2-15b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 52

neuralmagic/starcoder2-3b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 13

neuralmagic/starcoder2-7b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 15

neuralmagic/starcoder2-3b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 71

neuralmagic/starcoder2-7b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 32

neuralmagic/starcoder2-15b-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 43

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16

Text Generation • Updated Oct 10, 2024 • 365 • 12

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 482 • 1

neuralmagic/gemma-2-2b-it-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 24 • 1

neuralmagic/gemma-2-2b-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 42

neuralmagic/gemma-2-9b-it-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 159 • 1

neuralmagic/gemma-2-2b-it-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 2.64k • 1

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9, 2024 • 29