# T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github: [https://github.com/manueldeprada/Pretraining-T5-PyTorch-Lightning](https://github.com/manueldeprada/Pretraining-T5-PyTorch-Lightning).
{}
transformers pytorch t5 text2text-generation autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #t5 #text2text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

# T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github: URL
# T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github: URL
TAGS
#transformers #pytorch #t5 #text2text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
 # T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github: URL
passage: TAGS
#transformers #pytorch #t5 #text2text-generation #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
# T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github: URL