This Model is a fine-tuned version of T-systems [summarization model v1](https://huggingface.co/deutsche-telekom/mt5-small-sum-de-en-v1). 

We used 1000 examples of headline-content pairs from BR24 articles for the fine-tuning process.

Despite the small amount of training data, the tonality of the summarizations has changed significantly. Many of the resulting summaries do sound like a headline.

## Training

We used the following parameters for training this model:

+ base model: deutsche-telekom/mt5-small-sum-de-en-v1
+ source_prefix: "summarize: "
+ batch size: 4
+ max_source_length: 400
+ max_target_length: 35
+ weight_decay: 0.01
+ number of train epochs: 1
+ learning rate: 5e-5

## License

Since the base model is trained on the MLSUM dataset, this model may not be used for commercial use.

## Stats

| Model                                   | Rouge1    | Rouge2   | RougeL    | RougeLSum |
|-----------------------------------------|-----------|----------|-----------|-----------|
| headlines_test_small_example            | 13.573500 | 3.694700 | 12.560600 | 12.60000  |
| deutsche-telekom/mt5-small-sum-de-en-v1 | 10.6488   | 2.9313   | 10.0527   | 10.0523   |


{}
transformers pytorch mt5 text2text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #mt5 #text2text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

This Model is a fine-tuned version of T-systems summarization model v1.


We used 1000 examples of headline-content pairs from BR24 articles for the fine-tuning process.


Despite the small amount of training data, the tonality of the summarizations has changed significantly. Many of the resulting summaries do sound like a headline.


Training
--------


We used the following parameters for training this model:


* base model: deutsche-telekom/mt5-small-sum-de-en-v1
* source\_prefix: "summarize: "
* batch size: 4
* max\_source\_length: 400
* max\_target\_length: 35
* weight\_decay: 0.01
* number of train epochs: 1
* learning rate: 5e-5


License
-------


Since the base model is trained on the MLSUM dataset, this model may not be used for commercial use.


Stats
-----




TAGS
#transformers #pytorch #mt5 #text2text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

passage: TAGS
#transformers #pytorch #mt5 #text2text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
