class_docstr: A DataProvider that splits a string tensor into individual tokens and
  returns the tokens and the length.
  Optionally prepends or appends special tokens.
  
  Args:
    delimiter: Delimiter to split on. Must be a single character.
    tokens_feature_name: A descriptive feature name for the token values
    length_feature_name: A descriptive feature name for the length value
class_docstr_tok: ["A","DataProvider","that","splits","a","string","tensor","into","individual","tokens","and","returns","the","tokens","and","the","length",".","Optionally","prepends","or","appends","special","tokens",".","Args",":","delimiter",":","Delimiter","to","split","on",".","Must","be","a","single","character",".","tokens_feature_name",":","A","descriptive","feature","name","for","the","token","values","length_feature_name",":","A","descriptive","feature","name","for","the","length","value"]
code: def list_items(self):
      return [self.tokens_feature_name, self.length_feature_name]
  
file_path: seq2seq/seq2seq/data/split_tokens_decoder.py
imports: from __future__ import absolute_import
  from __future__ import division
  from __future__ import print_function
  from __future__ import unicode_literals
  import tensorflow
  from tensorflow.contrib.slim.python.slim.data import data_decoder
label_desc: Use image node_id 3 for calling the SplitTokensDecoder obj's underlying member method code with example usage: obj.list_items() and returns: list