class_docstr: Tokenizes UTF-8 by splitting when there is a change in Unicode script.
  
  By default, this tokenizer leaves out scripts matching the whitespace unicode
  property (use the `keep_whitespace` argument to keep it), so in this case the
  results are similar to the `WhitespaceTokenizer`. Any punctuation
  will get its own token (since it is in a different script), and any script
  change in the input string will be the location of a split.
  
  Example:
  >>> tokenizer = tf_text.UnicodeScriptTokenizer()
  >>> tokens = tokenizer.tokenize(["xy.,z de", "fg?h", "abαβ"])
  >>> print(tokens.to_list())
  [[b'xy', b'.,', b'z', b'de'], [b'fg', b'?', b'h'],
   [b'ab', b'\xce\xb1\xce\xb2']]
  
  >>> tokens = tokenizer.tokenize(u"累計7239人")
  >>> print(tokens)
  tf.Tensor([b'\xe7\xb4\xaf\xe8\xa8\x88' b'7239' b'\xe4\xba\xba'], shape=(3,),
            dtype=string)
  
  Both the punctuation and the whitespace in the first string have been split,
  but the punctuation run is present as a token while the whitespace isn't
  emitted (by default). The third example shows the case of a script change
  without any whitespace. This results in a split at that boundary point.
class_docstr_tok: ["Tokenizes","UTF-8","by","splitting","when","there","is","a","change","in","Unicode","script",".","By","default",",","this","tokenizer","leaves","out","scripts","matching","the","whitespace","unicode","property","(","use","the","`","keep_whitespace","`","argument","to","keep","it",")",",","so","in","this","case","the","results","are","similar","to","the","`","WhitespaceTokenizer","`",".","Any","punctuation","will","get","its","own","token","(","since","it","is","in","a","different","script",")",",","and","any","script","change","in","the","input","string","will","be","the","location","of","a","split",".","Example",":",">",">",">","tokenizer","=","tf_text.UnicodeScriptTokenizer","(",")",">",">",">","tokens","=","tokenizer.tokenize","(","[","``","xy.",",","z","de","''",",","``","fg","?","h","''",",","``","ab\u03b1\u03b2","''","]",")",">",">",">","print","(","tokens.to_list","(",")",")","[","[","b'xy","'",",","b'.",",","'",",","b","'","z","'",",","b'de","'","]",",","[","b'fg","'",",","b","'","?","'",",","b","'","h","'","]",",","[","b'ab","'",",","b'\\xce\\xb1\\xce\\xb2","'","]","]",">",">",">","tokens","=","tokenizer.tokenize","(","u","''","\u7d2f\u8a087239\u4eba","''",")",">",">",">","print","(","tokens",")","tf.Tensor","(","[","b'\\xe7\\xb4\\xaf\\xe8\\xa8\\x88","'","b'7239","'","b'\\xe4\\xba\\xba","'","]",",","shape=","(","3",",",")",",","dtype=string",")","Both","the","punctuation","and","the","whitespace","in","the","first","string","have","been","split",",","but","the","punctuation","run","is","present","as","a","token","while","the","whitespace","isn't","emitted","(","by","default",")",".","The","third","example","shows","the","case","of","a","script","change","without","any","whitespace",".","This","results","in","a","split","at","that","boundary","point","."]
docstr: Tokenizes UTF-8 by splitting when there is a change in Unicode script.
  
  The strings are split when successive tokens change their Unicode script
  or change being whitespace or not. The script codes used correspond to
  International Components for Unicode (ICU) UScriptCode values. See:
  http://icu-project.org/apiref/icu4c/uscript_8h.html
  
  ICU-defined whitespace characters are dropped, unless the `keep_whitespace`
  option was specified at construction time.
  
  Args:
    input: A `RaggedTensor`or `Tensor` of UTF-8 strings with any shape.
  
  Returns:
    A `RaggedTensor` of tokenized text. The returned shape is the shape of the
    input tensor with an added ragged dimension for tokens of each string.
docstr_tok: ["Tokenizes","UTF-8","by","splitting","when","there","is","a","change","in","Unicode","script",".","The","strings","are","split","when","successive","tokens","change","their","Unicode","script","or","change","being","whitespace","or","not",".","The","script","codes","used","correspond","to","International","Components","for","Unicode","(","ICU",")","UScriptCode","values",".","See",":","http",":","\/\/icu-project.org\/apiref\/icu4c\/uscript_8h.html","ICU-defined","whitespace","characters","are","dropped",",","unless","the","`","keep_whitespace","`","option","was","specified","at","construction","time",".","Args",":","input",":","A","`","RaggedTensor","`","or","`","Tensor","`","of","UTF-8","strings","with","any","shape",".","Returns",":","A","`","RaggedTensor","`","of","tokenized","text",".","The","returned","shape","is","the","shape","of","the","input","tensor","with","an","added","ragged","dimension","for","tokens","of","each","string","."]
code: def tokenize(self, input):  # pylint: disable=redefined-builtin
      """Tokenizes UTF-8 by splitting when there is a change in Unicode script.
  
      The strings are split when successive tokens change their Unicode script
      or change being whitespace or not. The script codes used correspond to
      International Components for Unicode (ICU) UScriptCode values. See:
      http://icu-project.org/apiref/icu4c/uscript_8h.html
  
      ICU-defined whitespace characters are dropped, unless the `keep_whitespace`
      option was specified at construction time.
  
      Args:
        input: A `RaggedTensor`or `Tensor` of UTF-8 strings with any shape.
  
      Returns:
        A `RaggedTensor` of tokenized text. The returned shape is the shape of the
        input tensor with an added ragged dimension for tokens of each string.
      """
      (tokens, _, _) = self.tokenize_with_offsets(input)
      return tokens
  
imports: from __future__ import absolute_import
  from __future__ import division
  from __future__ import print_function
  from tensorflow.python.eager import monitoring
  from tensorflow.python.framework import dtypes
  from tensorflow.python.framework import ops
  from tensorflow.python.ops import array_ops
  from tensorflow.python.ops import array_ops_stack
  from tensorflow.python.ops import math_ops
  from tensorflow.python.ops import string_ops
  from tensorflow.python.ops.ragged import ragged_conversion_ops
  from tensorflow.python.ops.ragged import ragged_string_ops
  from tensorflow.python.ops.ragged import ragged_tensor
  from tensorflow.python.ops.ragged.ragged_tensor import RaggedTensor
  from tensorflow_text.python.ops.tokenization import TokenizerWithOffsets
  from tensorflow.python.framework import load_library
  from tensorflow.python.platform import resource_loader
label_desc: Use image node_id 2 for calling the UnicodeScriptTokenizer obj's underlying member method code with example usage: obj.tokenize(input) and returns: tokens