class_docstr: A class that regroups important test to make sure that we properly handle the special tokens.
class_docstr_tok: ["A","class","that","regroups","important","test","to","make","sure","that","we","properly","handle","the","special","tokens","."]
code: def setUpClass(cls):
      tokenizer = T5Tokenizer(SAMPLE_VOCAB, extra_ids=0, legacy=False)
      tokenizer.add_special_tokens(
          {
              "additional_special_tokens": [
                  AddedToken("<extra_id_0>", rstrip=False, lstrip=False)
              ]
          }
      )
      # TODO ArthurZ the above is necessary as addedTokens / intialization sucks. Trie is not correctly created
      # So the extra ids are split....
      cls.tokenizer = tokenizer
  
imports: import json
  import os
  import re
  import tempfile
  import unittest
  from transformers import SPIECE_UNDERLINE, AddedToken, BatchEncoding, T5Tokenizer, T5TokenizerFast
  from transformers.testing_utils import get_tests_dir, require_sentencepiece, require_seqio, require_tokenizers, slow
  from transformers.utils import cached_property, is_tf_available, is_torch_available
  from ...test_tokenization_common import TokenizerTesterMixin
label_desc: Use image node_id 1 for calling the CommonSpmIntegrationTests obj's underlying member method code with example usage: obj.setUpClass(cls) without return types