[DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization](https://arxiv.org/abs/2109.02492).

## Introduction
DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a large version of DialogLED, the input length is limited to 5,120 in the pre-training phase.

## Finetuning for Downstream Tasks
Please refer to [our GitHub page](https://github.com/microsoft/DialogLM).
{}
transformers pytorch led text2text-generation arxiv:2109.02492 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #led #text2text-generation #arxiv-2109.02492 #autotrain_compatible #endpoints_compatible #region-us 

DialogLM: Pre-trained Model for Long Dialogue Understanding and Summarization.

## Introduction
DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a large version of DialogLED, the input length is limited to 5,120 in the pre-training phase.

## Finetuning for Downstream Tasks
Please refer to our GitHub page.
## Introduction
DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a large version of DialogLED, the input length is limited to 5,120 in the pre-training phase. ## Finetuning for Downstream Tasks
Please refer to our GitHub page.
TAGS
#transformers #pytorch #led #text2text-generation #arxiv-2109.02492 #autotrain_compatible #endpoints_compatible #region-us 
 ## Introduction
DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a large version of DialogLED, the input length is limited to 5,120 in the pre-training phase. ## Finetuning for Downstream Tasks
Please refer to our GitHub page.
passage: TAGS
#transformers #pytorch #led #text2text-generation #arxiv-2109.02492 #autotrain_compatible #endpoints_compatible #region-us 
## Introduction
DialogLED is a pre-trained model for long dialogue understanding and summarization. It builds on the Longformer-Encoder-Decoder (LED) architecture and uses window-based denoising as the pre-training task on a large amount of long dialogue data for further training. Here is a large version of DialogLED, the input length is limited to 5,120 in the pre-training phase.## Finetuning for Downstream Tasks
Please refer to our GitHub page.