docstr: Process a single line of raw inputs into tokens, it supports
  two input formats:
      1) a single line of texts (single sentence or a pair)
      2) a single line of pre-processed tokens (single sentence or a pair)
code: def tokenize(
      self,
      text_row: Optional[List[str]],
      token_row: Optional[List[List[str]]],
  ):
      """
      Process a single line of raw inputs into tokens, it supports
      two input formats:
          1) a single line of texts (single sentence or a pair)
          2) a single line of pre-processed tokens (single sentence or a pair)
      """
      raise NotImplementedError
  
imports: from typing import List, Optional, Tuple
  import torch
  from pytext.torchscript.utils import pad_2d_float, pad_3d_float, validate_padding_control
  from pytext.torchscript.vocab import ScriptVocabulary
  from pytorch.text.fb.utils.transform_utils import pad_2d
label_desc: Use image node_id 4 for calling the ScriptTensorizer obj's underlying member method code with example usage: obj.tokenize(text_row, token_row) without return types