<\s> token in the chat template instead of the </s> EOS token
#41
by
fabric
- opened
Hi,
Just wondered if the <\s>
token used in the chat template after the assistant content is here on purpose or if it is a typo.{% elif message['role'] == 'assistant' %}{{ ' ' + message['content'][0]['text'] + '<\\s> '}}
I can't find this <\s>
token in the tokenizer configuration, and it looks like the EOS token </s>
.
Thanks
No feedback on this issue?
That is a typo, yep, needs to be fixed!
Thanks @nielsr and @RaushanTurganbay , I opened a PR to fix the typo: https://huggingface.co/llava-hf/llava-v1.6-mistral-7b-hf/discussions/43