class_docstr: Tokenizer, Detokenizer and Normalizer utilities in Moses
docstr: Tokenizes text using Moses -> Sentencepiece.
docstr_tok: ["Tokenizes","text","using","Moses","-",">","Sentencepiece","."]
code: def tokenize(self, text: str):
      """
      Tokenizes text using Moses -> Sentencepiece.
      """
      return self.moses_tokenizer.tokenize(
          text, escape=False, return_str=True
      )
  
imports: from typing import List
  from sacremoses import MosesDetokenizer, MosesPunctNormalizer, MosesTokenizer
label_desc: Use image node_id 3 for calling the MosesProcessor obj's underlying member method code with example usage: obj.tokenize(text) and returns: self