Spaces:

Yersel
/

Meta-Llama-3.1-8B-Instruct

Sleeping

Yersel commited on Sep 14, 2024

Commit

96a4cae

1 Parent(s): 837f087

update terminators

Files changed (1) hide show

app.py CHANGED Viewed

@@ -49,7 +49,7 @@ def respuesta(
     terminators = [
         tokenizer.eos_token_id,
-        tokenizer.convert_tokens_to_ids("<eot_id>")
     ]
     outputs = model.generate(

     terminators = [
         tokenizer.eos_token_id,
+        tokenizer.convert_tokens_to_ids("<|eot_id|>")
     ]
     outputs = model.generate(