songy / transformers /utils /test_module /custom_tokenization.py
trishv's picture
Upload 2383 files
96e9536
raw
history blame contribute delete
88 Bytes
from transformers import BertTokenizer
class CustomTokenizer(BertTokenizer):
pass