
## facebook/bart-base model fine-tuned on CNN/DailyMail

This model was created using the [nn_pruning](https://github.com/huggingface/nn_pruning) python library: the linear layers contains **35%** of the original  weights.



The model contains **53%** of the original weights **overall** (the embeddings account for a significant part of the model, and they are not pruned by this method).

<div class="graph"><script src="/echarlaix/bart-base-cnn-r2-19.4-d35-hybrid/raw/main/model_card/density_info.js" id="c0afb977-b30c-485d-ac75-afc874392380"></script></div>

## Fine-Pruning details
This model was fine-tuned from the HuggingFace [model](https://huggingface.co/facebook/bart-base).

A side-effect of the block pruning is that some of the attention heads are completely removed: 38 heads were removed on a total of 216 (17.6%).

## Details of the CNN/DailyMail  dataset

|    Dataset    | Split | # samples |
| ------------- | ----- | --------- |
| CNN/DailyMail | train |   287K    |
| CNN/DailyMail | eval  |    13K    |


### Results

|    Metric   | # Value   | 
| ----------- | --------- |
| **Rouge 1** | **42.18** | 
| **Rouge 2** | **19.44** | 
| **Rouge L** | **39.17** | 

{"language": "en", "license": "apache-2.0", "tags": ["summarization"], "datasets": ["cnn_dailymail"], "metrics": ["R1", "R2", "RL"]}
transformers pytorch bart text2text-generation summarization en dataset:cnn_dailymail license:apache-2.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #bart #text2text-generation #summarization #en #dataset-cnn_dailymail #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 

facebook/bart-base model fine-tuned on CNN/DailyMail
----------------------------------------------------


This model was created using the nn\_pruning python library: the linear layers contains 35% of the original weights.


The model contains 53% of the original weights overall (the embeddings account for a significant part of the model, and they are not pruned by this method).



Fine-Pruning details
--------------------


This model was fine-tuned from the HuggingFace model.


A side-effect of the block pruning is that some of the attention heads are completely removed: 38 heads were removed on a total of 216 (17.6%).


Details of the CNN/DailyMail dataset
------------------------------------


Dataset: CNN/DailyMail, Split: train, # samples: 287K
Dataset: CNN/DailyMail, Split: eval, # samples: 13K


### Results




# samples: 287K
Dataset: CNN/DailyMail, Split: eval, # samples: 13K ### Results
TAGS
#transformers #pytorch #bart #text2text-generation #summarization #en #dataset-cnn_dailymail #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 
 # samples: 287K
Dataset: CNN/DailyMail, Split: eval, # samples: 13K ### Results
passage: TAGS
#transformers #pytorch #bart #text2text-generation #summarization #en #dataset-cnn_dailymail #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 
# samples: 287K
Dataset: CNN/DailyMail, Split: eval, # samples: 13K### Results