class_docstr: ASTTokens maintains the text of Python code in several forms: as a string, as line numbers, and
  as tokens, and is used to mark and access token and position information.
  
  ``source_text`` must be a unicode or UTF8-encoded string. If you pass in UTF8 bytes, remember
  that all offsets you'll get are to the unicode text, which is available as the ``.text``
  property.
  
  If ``parse`` is set, the ``source_text`` will be parsed with ``ast.parse()``, and the resulting
  tree marked with token info and made available as the ``.tree`` property.
  
  If ``tree`` is given, it will be marked and made available as the ``.tree`` property. In
  addition to the trees produced by the ``ast`` module, ASTTokens will also mark trees produced
  using ``astroid`` library <https://www.astroid.org>.
  
  If only ``source_text`` is given, you may use ``.mark_tokens(tree)`` to mark the nodes of an AST
  tree created separately.
class_docstr_tok: ["ASTTokens","maintains","the","text","of","Python","code","in","several","forms",":","as","a","string",",","as","line","numbers",",","and","as","tokens",",","and","is","used","to","mark","and","access","token","and","position","information",".","``","source_text","``","must","be","a","unicode","or","UTF8-encoded","string",".","If","you","pass","in","UTF8","bytes",",","remember","that","all","offsets","you","'ll","get","are","to","the","unicode","text",",","which","is","available","as","the","``",".text","``","property",".","If","``","parse","``","is","set",",","the","``","source_text","``","will","be","parsed","with","``","ast.parse","(",")","``",",","and","the","resulting","tree","marked","with","token","info","and","made","available","as","the","``",".tree","``","property",".","If","``","tree","``","is","given",",","it","will","be","marked","and","made","available","as","the","``",".tree","``","property",".","In","addition","to","the","trees","produced","by","the","``","ast","``","module",",","ASTTokens","will","also","mark","trees","produced","using","``","astroid","``","library","<","https",":","\/\/www.astroid.org",">",".","If","only","``","source_text","``","is","given",",","you","may","use","``",".mark_tokens","(","tree",")","``","to","mark","the","nodes","of","an","AST","tree","created","separately","."]
docstr: Same as get_token(), but interprets col_offset as a UTF8 offset, which is what `ast` uses.
docstr_tok: ["Same","as","get_token","(",")",",","but","interprets","col_offset","as","a","UTF8","offset",",","which","is","what","`","ast","`","uses","."]
code: def get_token_from_utf8(self, lineno, col_offset):
      # type: (int, int) -> Token
      """
      Same as get_token(), but interprets col_offset as a UTF8 offset, which is what `ast` uses.
      """
      return self.get_token(
          lineno, self._line_numbers.from_utf8_col(lineno, col_offset)
      )
  
imports: import abc
  import ast
  import bisect
  import sys
  import token
  from ast import Module
  from typing import Iterable, Iterator, List, Optional, Tuple, Any, cast, TYPE_CHECKING
  import six
  from six.moves import xrange
  from .line_numbers import LineNumbers
  from .util import Token, match_token, is_non_coding_token, patched_generate_tokens, last_stmt, annotate_fstring_nodes, generate_tokens, is_module, is_stmt
label_desc: Use image node_id 10 for calling the ASTTokens obj's underlying member method code with example usage: obj.get_token_from_utf8(lineno, col_offset) and returns: self