class_docstr: Base tokenizer class.
      
class_docstr_tok: ["Base","tokenizer","class","."]
code: def tokenize(self, text):
      raise NotImplementedError
  
imports: import os
  import numpy
  from paddlehub.common.logger import logger
label_desc: Use image node_id 2 for calling the Tokenizer obj's underlying member method code with example usage: obj.tokenize(text) without return types