class_docstr: Recreate a token stream formatted with the `RawTokenFormatter`.
  
  Additional options accepted:
  
  `compress`
      If set to ``"gz"`` or ``"bz2"``, decompress the token stream with
      the given compression algorithm before lexing (default: ``""``).
code: def get_tokens(self, text):
      if self.compress:
          if isinstance(text, str):
              text = text.encode("latin1")
          try:
              if self.compress == "gz":
                  import gzip
  
                  text = gzip.decompress(text)
              elif self.compress == "bz2":
                  import bz2
  
                  text = bz2.decompress(text)
          except OSError:
              yield Error, text.decode("latin1")
      if isinstance(text, bytes):
          text = text.decode("latin1")
  
      # do not call Lexer.get_tokens() because stripping is not optional.
      text = text.strip("\n") + "\n"
      for i, t, v in self.get_tokens_unprocessed(text):
          yield t, v
  
file_path: catboost/contrib/python/Pygments/py3/pygments/lexers/special.py
imports: import ast
  from pygments.lexer import Lexer, line_re
  from pygments.token import Token, Error, Text, Generic
  from pygments.util import get_choice_opt
label_desc: Use image node_id 2 for calling the RawTokenLexer obj's underlying member method code with example usage: obj.get_tokens(text) without return types