
Bert2Bert Summarization with 🤗EncoderDecoder Framework
This model is a warm-started *BERT2BERT* model fine-tuned on the *CNN/Dailymail* summarization dataset.

The model achieves a **18.22** ROUGE-2 score on *CNN/Dailymail*'s test dataset.

For more details on how the model was fine-tuned, please refer to 
[this](https://colab.research.google.com/drive/1Ekd5pUeCX7VOrMx94_czTkwNtLN32Uyu?usp=sharing) notebook.

{"language": "en", "license": "apache-2.0", "tags": ["summarization"], "datasets": ["cnn_dailymail"], "model-index": [{"name": "patrickvonplaten/bert2bert_cnn_daily_mail", "results": [{"task": {"type": "summarization", "name": "Summarization"}, "dataset": {"name": "cnn_dailymail", "type": "cnn_dailymail", "config": "3.0.0", "split": "test"}, "metrics": [{"type": "rouge", "value": 41.2808, "name": "ROUGE-1", "verified": true}, {"type": "rouge", "value": 18.6853, "name": "ROUGE-2", "verified": true}, {"type": "rouge", "value": 28.191, "name": "ROUGE-L", "verified": true}, {"type": "rouge", "value": 38.0871, "name": "ROUGE-LSUM", "verified": true}, {"type": "loss", "value": 2.3451855182647705, "name": "loss", "verified": true}, {"type": "gen_len", "value": 73.8332, "name": "gen_len", "verified": true}]}]}]}
transformers pytorch encoder-decoder text2text-generation summarization en dataset:cnn_dailymail license:apache-2.0 model-index autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #pytorch #encoder-decoder #text2text-generation #summarization #en #dataset-cnn_dailymail #license-apache-2.0 #model-index #autotrain_compatible #endpoints_compatible #has_space #region-us 


Bert2Bert Summarization with EncoderDecoder Framework
This model is a warm-started *BERT2BERT* model fine-tuned on the *CNN/Dailymail* summarization dataset.

The model achieves a 18.22 ROUGE-2 score on *CNN/Dailymail*'s test dataset.

For more details on how the model was fine-tuned, please refer to 
this notebook.

TAGS
#transformers #pytorch #encoder-decoder #text2text-generation #summarization #en #dataset-cnn_dailymail #license-apache-2.0 #model-index #autotrain_compatible #endpoints_compatible #has_space #region-us 

passage: TAGS
#transformers #pytorch #encoder-decoder #text2text-generation #summarization #en #dataset-cnn_dailymail #license-apache-2.0 #model-index #autotrain_compatible #endpoints_compatible #has_space #region-us 
