class_docstr: Construct a BPE tokenizer for HerBERT.
  
  Peculiarities:
  
  - uses BERT's pre-tokenizer: BaseTokenizer splits tokens on spaces, and also on punctuation. Each occurrence of a
    punctuation character will be treated separately.
  
  - Such pretokenized input is BPE subtokenized
  
  This tokenizer inherits from [`XLMTokenizer`] which contains most of the methods. Users should refer to the
  superclass for more information regarding methods.
docstr: Converts an index (integer) in a token (str) using the vocab.
docstr_tok: ["Converts","an","index","(","integer",")","in","a","token","(","str",")","using","the","vocab","."]
code: def _convert_id_to_token(self, index):
      """Converts an index (integer) in a token (str) using the vocab."""
      return self.decoder.get(index, self.unk_token)
  
imports: import json
  import os
  import re
  import unicodedata
  from typing import List, Optional, Tuple
  from ...tokenization_utils import PreTrainedTokenizer, _is_control, _is_punctuation, _is_whitespace
  from ...utils import logging
label_desc: Use image node_id 12 for calling the HerbertTokenizer obj's underlying member method code with example usage: obj._convert_id_to_token(index) and returns: self