class_docstr: Provides a consistent `Transform` interface to tokenizers operating on `DataFrame`s and folders
class_docstr_tok: ["Provides","a","consistent","`","Transform","`","interface","to","tokenizers","operating","on","`","DataFrame","`","s","and","folders"]
code: def _tokenize1(self, o):
      return first(self.tok([compose(*self.rules)(o)]))
  
imports: from __future__ import annotations
  from ..torch_basics import *
  from ..data.all import *
  import html
label_desc: Use image node_id 7 for calling the Tokenizer obj's underlying member method code with example usage: obj._tokenize1(o) and returns: first