Edit Models filters

Inference Providers

HF Inference API

Misc

arxiv: 2309.00071

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

483

Full-text search

Active filters: 2309.00071

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int8

Text Generation • Updated Nov 18, 2024 • 14.9k • 16

Qwen/Qwen2.5-Coder-32B-Instruct-GPTQ-Int4

Text Generation • Updated Nov 18, 2024 • 61.5k • 12

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 13.8k • 22

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated Jan 12 • 18.9k • 6

CISCai/Qwen2.5-Coder-32B-Instruct-SOTA-GGUF

Text Generation • Updated Jan 6 • 291 • 2

QuantFactory/Qwen2.5-Coder-14B-GGUF

Text Generation • Updated Nov 12, 2024 • 1.2k • 3

c01zaut/Qwen2.5-7B-Instruct-RK3588-1.1.4

Text Generation • Updated Dec 16, 2024 • 9 • 1

scb10x/typhoon2-qwen2.5-7b-instruct

Text Generation • Updated Dec 20, 2024 • 2.04k • 1

jarvisvasu/Qwen2.5-VL-3B-Instruct-4bit

Image-Text-to-Text • Updated 16 days ago • 287 • 2

unsloth/Qwen2.5-VL-3B-Instruct

Image-Text-to-Text • Updated 14 days ago • 1.37k • 1

unsloth/Qwen2.5-VL-7B-Instruct

Image-Text-to-Text • Updated 14 days ago • 1.04k • 2

unsloth/Qwen2.5-VL-72B-Instruct

Image-Text-to-Text • Updated 14 days ago • 50 • 1

unsloth/Qwen2.5-VL-7B-Instruct-bnb-4bit

Image-Text-to-Text • Updated 14 days ago • 1.56k • 3

Benasd/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 6 days ago • 978 • 1

Benasd/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated about 10 hours ago • 140 • 1

NousResearch/Yarn-Llama-2-7b-64k

Text Generation • Updated Oct 7, 2023 • 7.58k • 23

NousResearch/Yarn-Llama-2-13b-64k

Text Generation • Updated Sep 4, 2023 • 7.09k • 17

NousResearch/Yarn-Llama-2-13b-128k

Text Generation • Updated Sep 4, 2023 • 4.96k • 113

NousResearch/Yarn-Llama-2-7b-128k

Text Generation • Updated Sep 4, 2023 • 6.13k • 39

TheBloke/Yarn-Llama-2-7B-64K-GGUF

Updated Sep 27, 2023 • 695 • 9

TheBloke/Yarn-Llama-2-7B-64K-GGML

Updated Sep 27, 2023 • 8 • 3

TheBloke/Yarn-Llama-2-7B-64K-GPTQ

Text Generation • Updated Sep 27, 2023 • 44 • 1

TheBloke/Yarn-Llama-2-7B-128K-GGUF

Updated Sep 27, 2023 • 564 • 21

TheBloke/Yarn-Llama-2-7B-128K-GGML

Updated Sep 27, 2023 • 8 • 6

TheBloke/Yarn-Llama-2-13B-128K-GGML

Updated Sep 27, 2023 • 10 • 6

TheBloke/Yarn-Llama-2-13B-128K-GGUF

Updated Sep 27, 2023 • 1.38k • 37

TheBloke/Yarn-Llama-2-13B-64K-GGML

Updated Sep 27, 2023 • 9 • 5

TheBloke/Yarn-Llama-2-13B-64K-GGUF

Updated Sep 27, 2023 • 708 • 18

TheBloke/Yarn-Llama-2-13B-128K-GPTQ

Text Generation • Updated Sep 27, 2023 • 22 • 16

TheBloke/Yarn-Llama-2-7B-128K-GPTQ

Text Generation • Updated Sep 27, 2023 • 38 • 7