Edit Models filters

Model Tree

meta-llama/Llama-3.1-70B-Instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

109

Full-text search

Active filters: meta-llama/Llama-3.1-70B-Instruct

bartowski/Meta-Llama-3.1-70B-Instruct-exl2

Text Generation • Updated Aug 24, 2024 • 7

npc0/Meta-Llama-3.1-70B-Instruct-IQ_1S

Text Generation • Updated Aug 26, 2024 • 7

cmarkea/Meta-Llama-3.1-70B-Instruct-4bit

Text Generation • Updated Nov 14, 2024 • 19 • 1

Ffftdtd5dtft/Meta-Llama-3.1-70B-Instruct-Q2_K-GGUF

Text Generation • Updated Sep 3, 2024 • 52

MikeRoz/mattshumer_Reflection-Llama-3.1-70B-8.0bpw-h8-exl2

Text Generation • Updated Sep 9, 2024 • 5 • 1

XelotX/Reflection-Llama-3.1-70B-v1-XelotX-Original

Text Generation • Updated Sep 6, 2024 • 17

bullerwins/Reflection-70B-exl2_4.0bpw

Text Generation • Updated Sep 6, 2024 • 5

bullerwins/Reflection-70B-exl2_5.0bpw

Text Generation • Updated Sep 6, 2024 • 5 • 1

bullerwins/Reflection-70B-exl2_6.0bpw

Text Generation • Updated Sep 6, 2024 • 5 • 1

LoneStriker/Reflection-Llama-3.1-70B-2.4bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 5

LoneStriker/Reflection-Llama-3.1-70B-3.5bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 6

bigstorm/Reflections-Llama-3.1-70B-8.0bpw-8hb-exl2

Text Generation • Updated Sep 6, 2024 • 4

bullerwins/Reflection-70B-exl2_8.0bpw

Text Generation • Updated Sep 6, 2024 • 5

LoneStriker/Reflection-Llama-3.1-70B-4.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 5

LoneStriker/Reflection-Llama-3.1-70B-4.65bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 5

LoneStriker/Reflection-Llama-3.1-70B-5.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 5

LoneStriker/Reflection-Llama-3.1-70B-6.0bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 6 • 1

LoneStriker/Reflection-Llama-3.1-70B-2.25bpw-h6-exl2

Text Generation • Updated Sep 6, 2024 • 6

bigstorm/Reflections-Llama-3.1-70B-6.0bpw-8hb-exl2

Text Generation • Updated Sep 6, 2024 • 7 • 1

bullerwins/Reflection-70B-exl2_3.0bpw

Text Generation • Updated Sep 7, 2024 • 5

bullerwins/Reflection-70B-exl2_3.5bpw

Text Generation • Updated Sep 7, 2024 • 5

bullerwins/Reflection-70B-exl2_4.5bpw

Text Generation • Updated Sep 7, 2024 • 5

bullerwins/Reflection-70B-exl2_5.5bpw

Text Generation • Updated Sep 7, 2024 • 5

MikeRoz/mattshumer_ref_70_e3-8.0bpw-h8-exl2

Text Generation • Updated Sep 9, 2024 • 5

MikeRoz/mattshumer_ref_70_e3-4.0bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 5

MikeRoz/mattshumer_ref_70_e3-4.65bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 7

MikeRoz/mattshumer_ref_70_e3-2.25bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 6

MikeRoz/mattshumer_ref_70_e3-6.0bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 5

MikeRoz/mattshumer_ref_70_e3-5.0bpw-h6-exl2

Text Generation • Updated Sep 9, 2024 • 5

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • Updated Sep 17, 2024 • 47 • 46