TokenMarker . LineContext function ( ) { return lineContext ; }
the token handler can compare this object with the object previously given for this line to see if the token type at the end of the line has changed meaning subsequent lines might need to be retokenized . concode_field_sep Token lastToken concode_elem_sep TokenMarker.LineContext lineContext concode_elem_sep Token firstToken concode_field_sep void init concode_elem_sep void addToken concode_elem_sep ParserRuleSet getParserRuleSet concode_elem_sep void handleToken concode_elem_sep Token getTokens concode_elem_sep Token createToken concode_elem_sep void setLineContext