As the starting point of the BigBirdPegasus model , a checkpoint of Google's BigBirdPegasusForConditionalGeneration after finetuning for summarization on the big_patent dataset 24 is used. As the starting point for the Longformer Encoder Decoder (LED) model , the pretrained led-base-16384 model from AllenAI is employed. The action tokens are added to the tokenizer, the generated dataset are randomly split into training and validation sets (95:5) and the models are trained on A100-80GB GPUs for 885'225 steps (5 epochs) on the training split, using a batch size of 8, an initial learning rate of 5*10 -5 with a 0.05 warmup ratio, and a cosine weight decay. All other hyperparameters used the default values.