README.md
CHANGED
|
@@ -83,7 +83,6 @@ A 1-epoch checkpoint can be found at [pszemraj/pegasus-large-book-summary](https
|
|
| 83 |
## Intended uses & limitations
|
| 84 |
|
| 85 |
- standard pegasus has a max input length of 1024 tokens, therefore the model only saw the first 1024 tokens of a chapter when training, and learned to try to make the chapter's summary from that. Keep this in mind when using this model, as information at the end of a text sequence longer than 1024 tokens may be excluded from the final summary/the model will be biased towards information presented first.
|
| 86 |
-
- this was only trained on the dataset for an epoch but still provides reasonable results.
|
| 87 |
|
| 88 |
## Training and evaluation data
|
| 89 |
|
|
|
|
| 83 |
## Intended uses & limitations
|
| 84 |
|
| 85 |
- standard pegasus has a max input length of 1024 tokens, therefore the model only saw the first 1024 tokens of a chapter when training, and learned to try to make the chapter's summary from that. Keep this in mind when using this model, as information at the end of a text sequence longer than 1024 tokens may be excluded from the final summary/the model will be biased towards information presented first.
|
|
|
|
| 86 |
|
| 87 |
## Training and evaluation data
|
| 88 |
|