Duplicated from towing/t5-tokenizer-utils
a1ad15c
1
2
3
4
transformers==4.34.0 sentencepiece==0.1.99 numpy==1.24.2
