tools/traffic_annotation/scripts/annotation_tokenizer.py
def advance(self, expected_type: str) -> str:
    """Advance the tokenizer by one token, asserting its type.

    Throws an error if the token at point has the wrong type.

    Args:
      expected_type: expected |type| attribute of the token.

    Returns:
      The |value| attribute of the token at point.
    """
    token = self._get_token()
    self._assert_token_type(token, expected_type)
    self.pos = token.pos
    return token.value
Advance the tokenizer by one token, asserting its type.

    Throws an error if the token at point has the wrong type.

    Args:
      expected_type: expected |type| attribute of the token.

    Returns:
      The |value| attribute of the token at point.
    
Advance the tokenizer by one token, asserting its type.
Throws an error if the token at point has the wrong type.
Advance the tokenizer by one token asserting its type . Throws an error if the token at point has the wrong type .
def advance(self, expected_type: str) -> str:
    token = self._get_token()
    self._assert_token_type(token, expected_type)
    self.pos = token.pos
    return token.value
def advance ( self , expected_type : str ) -> str : token = self . _get_token ( ) self . _assert_token_type ( token , expected_type ) self . pos = token . pos return token . value
Advance the tokenizer by one token, asserting its type.
Advance the tokenizer by one token asserting its type .
"""Advance the tokenizer by one token, asserting its type.

    Throws an error if the token at point has the wrong type.

    Args:
      expected_type: expected |type| attribute of the token.

    Returns:
      The |value| attribute of the token at point.
    """
The |value| attribute of the token at point.
The |value| attribute of the token at point .
self
expected_type
str
expected |type| attribute of the token.
expected |type| attribute of the token .