Add fast tokenizer

#5
by olivierdehaene HF staff - opened
No description provided.
olivierdehaene changed pull request status to open

@Shitao @olivierdehaene Can this me merged?

Shitao changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment