class_docstr: Base class for tokenizers.
code: def _tokenize_on_split_symbol(self, text: Text) -> List[Text]:
      words = (
          text.split(self.intent_split_symbol)
          if self.intent_tokenization_flag
          else [text]
      )
  
      return words
  
imports: import abc
  import logging
  import re
  from typing import Text, List, Dict, Any, Optional
  from rasa.engine.graph import ExecutionContext, GraphComponent
  from rasa.engine.storage.resource import Resource
  from rasa.engine.storage.storage import ModelStorage
  from rasa.shared.nlu.training_data.training_data import TrainingData
  from rasa.shared.nlu.training_data.message import Message
  from rasa.nlu.constants import TOKENS_NAMES, MESSAGE_ATTRIBUTES
  from rasa.shared.nlu.constants import INTENT, INTENT_RESPONSE_KEY, RESPONSE_IDENTIFIER_DELIMITER, ACTION_NAME
  import rasa.shared.utils.io
label_desc: Use image node_id 6 for calling the Tokenizer obj's underlying member method code with example usage: obj._tokenize_on_split_symbol(text) and returns: words