class_docstr: A pytorch module that is a wrapper for FrozenCLIPEmbedder module. it enhances FrozenCLIPEmbedder, making it possible to
  have unlimited prompt length and assign weights to tokens in prompt.
docstr: Converts a batch of texts into a batch of token ids
docstr_tok: ["Converts","a","batch","of","texts","into","a","batch","of","token","ids"]
code: def tokenize(self, texts):
      """Converts a batch of texts into a batch of token ids"""
  
      raise NotImplementedError
  
imports: import math
  from collections import namedtuple
  import torch
  from modules import prompt_parser, devices, sd_hijack
  from modules.shared import opts
label_desc: Use image node_id 4 for calling the FrozenCLIPEmbedderWithCustomWordsBase obj's underlying member method code with example usage: obj.tokenize(texts) without return types