class_docstr: Runs end-to-end tokenziation.
code: def __init__(self, vocab_file=default_vocab(), do_lower_case=True):
      self.vocab = load_vocab(vocab_file)
      self.inv_vocab = {v: k for k, v in self.vocab.items()}
      self.basic_tokenizer = BasicTokenizer(do_lower_case=do_lower_case)
      self.wordpiece_tokenizer = WordpieceTokenizer(vocab=self.vocab)
  
imports: from __future__ import absolute_import
  from __future__ import division
  from __future__ import print_function
  import collections
  import os
  import re
  import unicodedata
  from functools import lru_cache
  import six
label_desc: Use image node_id 1 to create a new FullTokenizer object from inherited base classes: object with example: obj = FullTokenizer(vocab_file, do_lower_case)