class_docstr: Language dependent tokenizer of text document.
class_docstr_tok: ["Language","dependent","tokenizer","of","text","document","."]
code: def __init__(self, language):
      language = normalize_language(language)
      self._language = language
  
      tokenizer_language = self.LANGUAGE_ALIASES.get(language, language)
      self._sentence_tokenizer = self._get_sentence_tokenizer(
          tokenizer_language
      )
      self._word_tokenizer = self._get_word_tokenizer(
          tokenizer_language
      )
  
imports: from __future__ import absolute_import
  from __future__ import division, print_function, unicode_literals
  import re
  import string
  import zipfile
  import nltk
  from .._compat import to_string, to_unicode, unicode
  from ..utils import normalize_language
label_desc: Use image node_id 1 to create a new Tokenizer object from inherited base classes: object with example: obj = Tokenizer(language)