bert-imdb-model / tokenizer_config.json
philipobiorah's picture
Create tokenizer_config.json
5042d0a verified
raw
history blame
214 Bytes
{
"do_lower_case": true,
"max_len": 512,
"model_max_length": 512,
"padding_side": "right",
"special_tokens_map_file": "special_tokens_map.json",
"tokenizer_class": "BertTokenizer",
"use_fast": true
}