zjyhfchanged pull request title from
The tokenizer adds a special token '<|im_end|>' to solve the problem of non-stop generation when encountering <|im_end|>.
to This is a wrong solution, a new PR has been submitted, sorry...
Your need to confirm your account before you can post a new comment.
