class_docstr: Runs pre-tokenization with Jieba segmentation tool. It is used in CPM models.
class_docstr_tok: ["Runs","pre-tokenization","with","Jieba","segmentation","tool",".","It","is","used","in","CPM","models","."]
docstr: Converts an index (integer) in a token (str) using the vocab.
docstr_tok: ["Converts","an","index","(","integer",")","in","a","token","(","str",")","using","the","vocab","."]
code: def _convert_id_to_token(self, index):
      """Converts an index (integer) in a token (str) using the vocab."""
      return self.sp_model.IdToPiece(index)
  
imports: import os
  import unicodedata
  from shutil import copyfile
  from typing import Any, Dict, List, Optional, Tuple
  import sentencepiece
  from ...tokenization_utils import AddedToken, PreTrainedTokenizer
  from ...utils import SPIECE_UNDERLINE, logging
label_desc: Use image node_id 9 for calling the CpmTokenizer obj's underlying member method code with example usage: obj._convert_id_to_token(index) and returns: self