tekken.json from the original repo is missing and fails when running on vLLM
#2
by
alecauduro
- opened
I got an error when setting --tokenizer-mode mistral in vLLM, then I noticed the tokenizer file tekken.json was not in the repo.