class_docstr: Tokenizer that uses a Hub module.
  
  This class is just a wrapper around an internal HubModuleSplitter.  It offers
  the same functionality, but with 'token'-based method names: e.g., one can use
  tokenize() instead of the more general and less informatively named split().
  
  Example:
  
  >>> HUB_MODULE = "https://tfhub.dev/google/zh_segmentation/1"
  >>> segmenter = HubModuleTokenizer(HUB_MODULE)
  >>> segmenter.tokenize(["新华社北京"])
  <tf.RaggedTensor [[b'\xe6\x96\xb0\xe5\x8d\x8e\xe7\xa4\xbe',
                     b'\xe5\x8c\x97\xe4\xba\xac']]>
  
  You can also use this tokenizer to return the split strings and their offsets:
  
  >>> HUB_MODULE = "https://tfhub.dev/google/zh_segmentation/1"
  >>> segmenter = HubModuleTokenizer(HUB_MODULE)
  >>> pieces, starts, ends = segmenter.tokenize_with_offsets(["新华社北京"])
  >>> print("pieces: %s starts: %s ends: %s" % (pieces, starts, ends))
  pieces: <tf.RaggedTensor [[b'\xe6\x96\xb0\xe5\x8d\x8e\xe7\xa4\xbe',
                             b'\xe5\x8c\x97\xe4\xba\xac']]>
  starts: <tf.RaggedTensor [[0, 9]]>
  ends: <tf.RaggedTensor [[9, 15]]>
docstr: Initializes a new HubModuleTokenizer instance.
  
  Args:
    hub_module_handle: A string handle accepted by hub.load().  Supported
      cases include (1) a local path to a directory containing a module, and
      (2) a handle to a module uploaded to e.g., https://tfhub.dev
docstr_tok: ["Initializes","a","new","HubModuleTokenizer","instance",".","Args",":","hub_module_handle",":","A","string","handle","accepted","by","hub.load","(",")",".","Supported","cases","include","(","1",")","a","local","path","to","a","directory","containing","a","module",",","and","(","2",")","a","handle","to","a","module","uploaded","to","e.g.",",","https",":","\/\/tfhub.dev"]
code: def __init__(self, hub_module_handle):
      """Initializes a new HubModuleTokenizer instance.
  
      Args:
        hub_module_handle: A string handle accepted by hub.load().  Supported
          cases include (1) a local path to a directory containing a module, and
          (2) a handle to a module uploaded to e.g., https://tfhub.dev
      """
      super(HubModuleTokenizer, self).__init__()
      self._splitter = hub_module_splitter.HubModuleSplitter(
          hub_module_handle
      )
  
imports: from tensorflow.python.eager import monitoring
  from tensorflow_text.python.ops import hub_module_splitter
  from tensorflow_text.python.ops.tokenization import TokenizerWithOffsets
label_desc: Use image node_id 1 to create a new HubModuleTokenizer object from inherited base classes: TokenizerWithOffsets with example: obj = HubModuleTokenizer(hub_module_handle)