meta-llama
/

Llama-3.1-8B-Instruct

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (35)

unable to load 4-bit quantized varient with llama.cpp

#31 opened 8 months ago by

Garbage output ?

#30 opened 8 months ago by

Question about chat template and fine-tuning

#23 opened 8 months ago by

Issues loading model with ooabooga textgenwebui

#20 opened 8 months ago by

what is the right tokenizer should I use for llama 3.1 8B?

#19 opened 8 months ago by

The sample code on the model card page is not right

#18 opened 8 months ago by

My alternative quantizations.

#16 opened 8 months ago by

ValueError: `rope_scaling` must be a dictionary with two fields

#15 opened 8 months ago by

Independently Benchmarked Humaneval and Evalplus scores

#13 opened 8 months ago by

DO NOT MERGE v2 make sure vllm and transformers work

#12 opened 8 months ago by

DO NOT MERGE test for vllm

#11 opened 8 months ago by

Please do not include original PTH files.

#10 opened 8 months ago by

Utterly based

#9 opened 8 months ago by