chunk_content: }
  
  Preprocess dataset
  	
  Next, you’ll setup a tokenizer; configure the appropriate padding token to use for padding sequences, and determine the maximum length of the tokenized labels:
  
  
  	Copied
  tokenizer = AutoTokenizer.from_pretrained(model_name_or_path)
  if tokenizer.pad_token_id is None:
      tokenizer.pad_token_id = tokenizer.eos_token_id
  target_max_length = max([len(tokenizer(class_label)["input_ids"]) for class_label in classes])
  print(targ