Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

text-generation-inference

Inference Endpoints

AutoTrain Compatible

4-bit precision

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

216,323

Full-text search

Active filters: text-generation-inference

IlyaGusev/saiga_gemma2_9b

Text Generation • Updated Jul 22, 2024 • 958 • 15

amitca71/text2cypher_unsloth_Mistral-Nemo-Instruct-2407-bnb-8bit_gguf

Updated Jul 21, 2024 • 25 • 1

maharnab/gpt2_pycode

Text Generation • Updated Jul 21, 2024 • 73 • 2

princeton-nlp/Llama-3-8B-ProLong-64k-Instruct

Text Generation • Updated Oct 31, 2024 • 2.12k • 13

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.85k • 35

dohrisalim/Code-7B-slerp

Text Generation • Updated Jul 21, 2024 • 13 • 1

ChenMnZ/Llama-2-7b-EfficientQAT-w2g64-GPTQ

Text Generation • Updated Jul 22, 2024 • 13 • 1

ricdomolm/lawma-8b

Text Generation • Updated 30 days ago • 3k • 8

bunnycore/L3-Intermix-v0.2

Text Generation • Updated Jul 22, 2024 • 17 • 2

ndebuhr/Gemma-2-27B-Technical-Tutorial-Summarization-QLoRA

Text Generation • Updated Jul 22, 2024 • 13 • 1

shuyuej/Mixtral-8x22B-Instruct-v0.1-GPTQ

Text Generation • Updated Jul 25, 2024 • 33 • 1

BeaverAI/mistral-doryV2-12b

Text Generation • Updated Jul 22, 2024 • 107 • 22

IlyaGusev/saiga_tlite_8b_abliterated_sft_m1_d9

Text Generation • Updated Jul 22, 2024 • 9 • 3

EmergentMethods/Phi-3-medium-128k-instruct-graph

Text Generation • Updated Aug 15, 2024 • 49 • 29

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 17.2k • 9

braindao/iq-code-evmind-v3.2-qwen2-1.5b-instruct-average

Text Generation • Updated Aug 13, 2024 • 52 • 1

unsloth/Meta-Llama-3.1-8B-bnb-4bit

Text Generation • Updated Feb 15 • 130k • 101

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29, 2024 • 713 • 4

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Feb 15 • 427k • 63

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 5.02k • 31

unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 13.2k • 30

unsloth/Meta-Llama-3.1-8B-Instruct

Text Generation • Updated Feb 15 • 453k • 53

l3lab/ntpctx-llama3-8b

Text Generation • Updated Aug 30, 2024 • 32 • 2

unsloth/Meta-Llama-3.1-405B-bnb-4bit

Text Generation • Updated Sep 11, 2024 • 1.42k • 16

shuyuej/Mistral-Nemo-Instruct-2407-GPTQ

Text Generation • Updated Jul 25, 2024 • 286 • 5

cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b

Text Generation • Updated Jul 26, 2024 • 5.07k • 100

neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8

Text Generation • Updated Oct 9, 2024 • 46.6k • 40

neuralmagic/Meta-Llama-3.1-70B-Instruct-FP8-dynamic

Text Generation • Updated Oct 19, 2024 • 4.8k • 6

teknium/Llama-3.1-AlternateTokenizer

Text Generation • Updated Jul 27, 2024 • 163 • 4

Nitral-AI/Hathor_Sofit-L3-8B-v1

Text Generation • Updated Feb 1 • 123 • 22