Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2210.17323

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Mixture of Experts

Models

156

Full-text search

Active filters: 2210.17323

neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated 16 days ago • 3.79k • 7

astronomer/Llama-3-8B-Instruct-GPTQ-4-Bit

Text Generation • Updated Apr 22, 2024 • 6.92k • 25

IntelLabs/sqft-phi-3-mini-4k-50-base-gptq

Text Generation • Updated about 1 month ago • 595 • 2

IntelLabs/sqft-mistral-7b-v0.3-50-base-gptq

Text Generation • Updated Feb 12 • 485 • 2

neuralmagic/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 34.8k • 14

neuralmagic/Meta-Llama-3.1-70B-Instruct-quantized.w4a16

Text Generation • Updated about 1 month ago • 15.1k • 31

neuralmagic/Mistral-Nemo-Instruct-2407-quantized.w4a16

Text Generation • Updated Oct 9, 2024 • 536 • 4

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 97 • 3

IntelLabs/sqft-phi-3-mini-4k-instruct-base-gptq

Text Generation • Updated about 1 month ago • 192 • 2

IntelLabs/sqft-phi-3.5-mini-instruct-base-gptq

Text Generation • Updated about 1 month ago • 225 • 3

neuralmagic/DeepSeek-R1-Distill-Llama-8B-quantized.w8a8

Text Generation • Updated 16 days ago • 1.36k • 1

neuralmagic/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • Updated 16 days ago • 2.22k • 1

neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w4a16

Text Generation • Updated 16 days ago • 1.36k • 2

neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w4a16

Text Generation • Updated 16 days ago • 4.19k • 3

neuralmagic/DeepSeek-R1-Distill-Qwen-7B-quantized.w8a8

Text Generation • Updated 16 days ago • 1.29k • 2

rinna/qwen2.5-bakeneko-32b-instruct-gptq-int8

Text Generation • Updated 29 days ago • 115 • 1

BelleGroup/BELLE-7B-gptq

Text2Text Generation • Updated Apr 20, 2023 • 21 • 26

sardukar/llama13b-4bit-v2

Text Generation • Updated Apr 8, 2023 • 17 • 5

sardukar/llama7b-4bit-v2

Text Generation • Updated Apr 6, 2023 • 10 • 3

BelleGroup/BELLE-LLaMA-7B-2M-gptq-enc

Text2Text Generation • Updated Apr 12, 2023 • 2

BelleGroup/BELLE_BLOOM_GPTQ_4BIT

Text Generation • Updated Apr 20, 2023 • 13 • 3

Thireus/Vicuna13B-v1.1-8bit-128g

Text Generation • Updated Apr 22, 2023 • 37 • 16

mayank-mishra/starcoderbase-GPTQ-4bit-128g

Updated May 5, 2023 • 21

mayank-mishra/starcoderbase-GPTQ-8bit-128g

Updated May 5, 2023 • 3

mayank-mishra/santacoder-GPTQ-8bit-128g

Updated May 4, 2023 • 1

mayank-mishra/santacoder-GPTQ-4bit-128g

Updated May 4, 2023 • 2

mayank-mishra/starcoder-GPTQ-4bit-128g

Updated May 5, 2023 • 16

mayank-mishra/starcoder-GPTQ-8bit-128g

Updated May 5, 2023 • 11

ssaroya/gptq_model

Updated May 25, 2023

Honkware/Manticore-13b-Landmark-GPTQ

Text Generation • Updated Jun 14, 2023 • 13 • 2