class_docstr: Runs WordPiece tokenziation.
class_docstr_tok: ["Runs","WordPiece","tokenziation","."]
code: def __init__(self, vocab=None, unk_token="[UNK]"):
      self.vocab = load_vocab(vocab)
      self.inv_vocab = {v: k for k, v in self.vocab.items()}
      self.unk_token = unk_token
  
file_path: OpenNRE/opennre/tokenization/word_tokenizer.py
imports: from __future__ import absolute_import
  from __future__ import division
  from __future__ import print_function
  import unicodedata
  from .utils import load_vocab, convert_to_unicode, clean_text, split_on_whitespace, convert_by_vocab, tokenize_chinese_chars
label_desc: Use image node_id 1 to create a new WordTokenizer object from inherited base classes: object with example: obj = WordTokenizer(vocab, unk_token)