default method to extract only one-character tokens from the source . subclasses can override this method to construct language-specific tokens . after extracting the token , the current source line position will be one beyond the last token character . concode_field_sep int lineNum concode_elem_sep String text concode_elem_sep Source source concode_elem_sep int position concode_elem_sep TokenType type concode_elem_sep Object value concode_field_sep Object getValue concode_elem_sep int getLineNumber concode_elem_sep char currentChar concode_elem_sep int getPosition concode_elem_sep TokenType getType concode_elem_sep String getText concode_elem_sep char nextChar concode_elem_sep char peekChar
void function ( ) { text = Character . toString ( currentChar ( ) ) ; value = null ; nextChar ( ) ; }