class_docstr: A ``WordTokenizer`` handles the splitting of strings into words as well as any desired
  post-processing (e.g., stemming, filtering, etc.).  Note that we leave one particular piece of
  post-processing for later: the decision of whether or not to lowercase the token.  This is for
  two reasons: (1) if you want to make two different casing decisions for whatever reason, you
  won't have to run the tokenizer twice, and more importantly (2) if you want to lowercase words
  for your word embedding, but retain capitalization in a character-level representation, we need
  to retain the capitalization here.
  
  Parameters
  ----------
  word_splitter : ``WordSplitter``, optional
      The :class:`WordSplitter` to use for splitting text strings into word tokens.  The default
      is to use the ``SpacyWordSplitter`` with default parameters.
  word_filter : ``WordFilter``, optional
      The :class:`WordFilter` to use for, e.g., removing stopwords.  Default is to do no
      filtering.
  word_stemmer : ``WordStemmer``, optional
      The :class:`WordStemmer` to use.  Default is no stemming.
  start_tokens : ``List[str]``, optional
      If given, these tokens will be added to the beginning of every string we tokenize.
  end_tokens : ``List[str]``, optional
      If given, these tokens will be added to the end of every string we tokenize.
code: def batch_tokenize(self, texts):
      batched_words = self._word_splitter.batch_split_words(texts)
      return [self._filter_and_stem(words) for words in batched_words]
  
file_path: magnitude/pymagnitude/third_party/allennlp/data/tokenizers/word_tokenizer.py
imports: from __future__ import absolute_import
  from allennlp.data.tokenizers.token import Token
  from allennlp.data.tokenizers.tokenizer import Tokenizer
  from allennlp.data.tokenizers.word_filter import WordFilter, PassThroughWordFilter
  from allennlp.data.tokenizers.word_splitter import WordSplitter, SpacyWordSplitter
  from allennlp.data.tokenizers.word_stemmer import WordStemmer, PassThroughWordStemmer
label_desc: Use image node_id 3 for calling the WordTokenizer obj's underlying member method code with example usage: obj.batch_tokenize(texts) and returns: unknown