class_docstr: Base class for word tokenizers
class_docstr_tok: ["Base","class","for","word","tokenizers"]
docstr: Create a list of tokens from a string.
  This method should be overridden by subclasses of WordTokenizer.
docstr_tok: ["Create","a","list","of","tokens","from","a","string",".","This","method","should","be","overridden","by","subclasses","of","WordTokenizer","."]
code: def tokenize(self, text: str, model=None):
      """
      Create a list of tokens from a string.
      This method should be overridden by subclasses of WordTokenizer.
      """
      pass
  
imports: import logging
  import re
  from abc import abstractmethod
  from typing import List
  from nltk.tokenize import TreebankWordTokenizer
  from nltk.tokenize.punkt import PunktParameters, PunktSentenceTokenizer
label_desc: Use image node_id 1 for calling the WordTokenizer obj's underlying member method code with example usage: obj.tokenize(text, model) without return types