Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

6,222

Full-text search

Active filters: awq

kaiwangrv/Llama-2-7b-hf_awq

Text Generation • Updated Jul 9, 2024 • 6

darthhexx/Phi-3-medium-128k-instruct-awq

Text Generation • Updated Jul 10, 2024 • 16

internlm/internlm-xcomposer2d5-7b-4bit

Visual Question Answering • Updated Aug 5, 2024 • 1.11k • 13

AnhQuangNguyen/Vistral-7B-Chat-function-calling-awq

Text Generation • Updated Jul 15, 2024 • 68

PrunaAI/dreamgen-WizardLM-2-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 153

PrunaAI/MaziyarPanahi-Mistral-7B-v0.3-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 152

PrunaAI/cognitivecomputations-dolphin-2.9.1-llama-3-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 160

PrunaAI/openchat-openchat-3.5-0106-gemma-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 153

PrunaAI/Remek-Llama-3-8B-Omnibus-1-PL-v01-INSTRUCT-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 151

Weni/ZeroShot-Agents-Llama3-4.0.62-SFT-AWQ

Text Generation • Updated Jul 12, 2024 • 152

Weni/ZeroShot-Agents-Llama3-4.0.63-DPO-AWQ

Text Generation • Updated Jul 12, 2024 • 153

Alirezamp/Mistral-7B-v0.3-news-category_awq

Text Generation • Updated Jul 12, 2024 • 152

aqweteddy/Llama3-Taiwan-70B-Instruct-128K-AWQ-4bits

Text Generation • Updated Jul 12, 2024 • 9

Weni/ZeroShot-Agents-Llama3-4.0.63-DPO-100-AWQ

Text Generation • Updated Jul 12, 2024 • 152

Weni/WeniGPT-Agents-Llama3-5.1.2-SFT-AWQ

Text Generation • Updated Jul 12, 2024 • 152

Weni/WeniGPT-Agents-Llama3-5.1.4-SFT-AWQ

Text Generation • Updated Aug 22, 2024 • 33

PrunaAI/cgato-L3-TheSpice-8b-v0.8.3-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 155

PrunaAI/Qwen-CodeQwen1.5-7B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 169

PrunaAI/DeepMount00-Mistral-Ita-7b-AWQ-4bit-smashed

Text Generation • Updated Jul 12, 2024 • 150

PrunaAI/tokyotech-llm-Swallow-7b-instruct-hf-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 155

PrunaAI/rhaymison-Mistral-portuguese-luana-7b-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 148

PrunaAI/01-ai-Yi-1.5-9B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 153

Weni/ZeroShot-Agents-Llama3-4.0.64-DPO-AWQ

Text Generation • Updated Jul 13, 2024 • 151

PrunaAI/VAGOsolutions-Llama-3-SauerkrautLM-8b-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 172

PrunaAI/VAGOsolutions-SauerkrautLM-1.5b-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 154

PrunaAI/Qwen-Qwen2-7B-Instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 151

PrunaAI/Qwen-Qwen1.5-4B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 152

PrunaAI/SeaLLMs-SeaLLM-7B-v2-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 153

PrunaAI/ibm-granite-granite-8b-code-base-AWQ-4bit-smashed

Text Generation • Updated Jul 13, 2024 • 155

Weni/ZeroShot-Agents-Llama3-4.0.65-DPO-AWQ

Text Generation • Updated Jul 13, 2024 • 151