<\s> token in the chat template instead of the </s> EOS token

#41
by fabric - opened

Hi,

Just wondered if the <\s> token used in the chat template after the assistant content is here on purpose or if it is a typo.
{% elif message['role'] == 'assistant' %}{{ ' ' + message['content'][0]['text'] + '<\\s> '}}

I can't find this <\s> token in the tokenizer configuration, and it looks like the EOS token </s>.

Thanks

No feedback on this issue?

Llava Hugging Face org

Pinging @RaushanTurganbay here

Llava Hugging Face org

That is a typo, yep, needs to be fixed!

Sign up or log in to comment