List < String > function ( CharSequence arg0 ) { Preconditions . checkNotNull ( arg0 ) ; TwitterTokenStream loc0 = getDefaultTokenStream ( ) ; loc0 . reset ( arg0 ) ; return loc0 . toStringList ( ) ; }
tokenizes a charsequence into a list of strings . concode_field_sep TwitterTokenStream tokenizationStream concode_field_sep TwitterTokenStream getDefaultTokenStream concode_elem_sep TwitterTokenStream applyDefaultChain concode_elem_sep TokenizedCharSequence tokenize