class_docstr: Test case for SentencePieceProcessor
class_docstr_tok: ["Test","case","for","SentencePieceProcessor"]
code: def test_normalize(self):
      sp = spm.SentencePieceProcessor(
          model_file=os.path.join("test", "test_model.model")
      )
  
      self.assertEqual("▁KADOKAWAABC", sp.normalize("ＫＡＤＯＫＡＷＡABC"))
      self.assertEqual("▁KADOKAWAABC", sp.Normalize("ＫＡＤＯＫＡＷＡABC"))
  
      x = sp.Normalize("ＫＡＤＯＫＡＷＡABC", with_offsets=True)
      self.assertEqual("▁KADOKAWAABC", x[0])
      self.assertEqual(
          [0, 0, 0, 0, 3, 6, 9, 12, 15, 18, 21, 24, 25, 26, 27], x[1]
      )
  
      self.assertEqual(
          ["▁KADOKAWAABC", "▁平成"], sp.normalize(["ＫＡＤＯＫＡＷＡABC", "㍻"])
      )
      self.assertEqual(
          ["▁KADOKAWAABC", "▁平成"], sp.Normalize(["ＫＡＤＯＫＡＷＡABC", "㍻"])
      )
  
      x = sp.Normalize(["ＫＡＤＯＫＡＷＡABC", "㍻"], with_offsets=True)
      self.assertEqual(len(x), 2)
      self.assertEqual("▁KADOKAWAABC", x[0][0])
      self.assertEqual(
          [0, 0, 0, 0, 3, 6, 9, 12, 15, 18, 21, 24, 25, 26, 27], x[0][1]
      )
      self.assertEqual("▁平成", x[1][0])
      self.assertEqual([0, 0, 0, 0, 0, 0, 0, 0, 0, 3], x[1][1])
  
imports: from collections import defaultdict
  import io
  import os
  import pickle
  import sys
  import unittest
  import sentencepiece
label_desc: Use image node_id 20 for calling the TestSentencepieceProcessor obj's underlying member method code with example usage: obj.test_normalize() without return types