class_docstr: Abstract base class for converting between text and integers.
  
  **A note on padding**:
  
    Because text data is typically variable length and nearly always requires
    padding during training, ID 0 is always reserved for padding. To accommodate
    this, all `TextEncoder`s behave in certain ways:
  
    * `encode`: never returns id 0 (all ids are 1+)
    * `decode`: drops 0 in the input ids
    * `vocab_size`: includes ID 0
  
    New subclasses should be careful to match this behavior.
class_docstr_tok: ["Abstract","base","class","for","converting","between","text","and","integers",".","*","*","A","note","on","padding","*","*",":","Because","text","data","is","typically","variable","length","and","nearly","always","requires","padding","during","training",",","ID","0","is","always","reserved","for","padding",".","To","accommodate","this",",","all","`","TextEncoder","`","s","behave","in","certain","ways",":","*","`","encode","`",":","never","returns","id","0","(","all","ids","are","1+",")","*","`","decode","`",":","drops","0","in","the","input","ids","*","`","vocab_size","`",":","includes","ID","0","New","subclasses","should","be","careful","to","match","this","behavior","."]
code: def __repr__(self):
      return "<%s vocab_size=%d>" % (
          type(self).__name__,
          self.vocab_size,
      )
  
imports: from __future__ import unicode_literals
  import abc
  import hashlib
  import json
  import re
  from tensorflow_datasets.core.utils.lazy_imports_utils import tensorflow
label_desc: Use image node_id 8 for calling the TextEncoder obj's underlying member method code with example usage: obj.__repr__() and returns: unknown