class_docstr: Class for splitting texts on tokens using NLTK
  
  Args:
      tokenizer: tokenization mode for `nltk.tokenize`
      download: whether to download nltk data
  
  Attributes:
      tokenizer: tokenizer instance from nltk.tokenizers
code: def __init__(
      self,
      tokenizer: str = "wordpunct_tokenize",
      download: bool = False,
      *args,
      **kwargs,
  ):
      if download:
          nltk.download()
      self.tokenizer = getattr(nltk.tokenize, tokenizer, None)
      if not callable(self.tokenizer):
          raise AttributeError(
              "Tokenizer {} is not defined in nltk.tokenizer".format(
                  tokenizer
              )
          )
  
imports: from typing import List
  import nltk
  from deeppavlov.core.common.registry import register
  from deeppavlov.core.models.component import Component
label_desc: Use image node_id 1 to create a new NLTKTokenizer object from inherited base classes: Component with example: obj = NLTKTokenizer(tokenizer, download)