
# GPT-2 Small Portuguese Lyrics

Pretrained model from lyrics dataset in Portuguese.

## Model description

The model was trained from a Kaggle Dataset, [“Song lyrics from 6 musical genres”](https://www.kaggle.com/neisse/scrapped-lyrics-from-6-genres/version/2), with around 66,000 songs in portuguese.

The model was fine-tuned from [GPorTuguese-2](https://huggingface.co/pierreguillou/gpt2-small-portuguese) on Colab Pro+ enviroment.

<!--- 
## Intended uses & limitations

### How to use

### Limitations and bias

## Training data

## Training procedure

### Preprocessing

### BibTeX entry and citation info
-->

## Evaluation results

| Loss     | Perplexity | Training Duration |
|:--------:|:----------:|:-----------------:|
|3,301     | 27,15      | 06:45:09          |




{"language": "pt", "license": "mit"}
transformers pytorch tf tensorboard gpt2 text-generation pt license:mit autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #tf #tensorboard #gpt2 #text-generation #pt #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

GPT-2 Small Portuguese Lyrics
=============================


Pretrained model from lyrics dataset in Portuguese.


Model description
-----------------


The model was trained from a Kaggle Dataset, “Song lyrics from 6 musical genres”, with around 66,000 songs in portuguese.


The model was fine-tuned from GPorTuguese-2 on Colab Pro+ enviroment.


Evaluation results
------------------




TAGS
#transformers #pytorch #tf #tensorboard #gpt2 #text-generation #pt #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

passage: TAGS
#transformers #pytorch #tf #tensorboard #gpt2 #text-generation #pt #license-mit #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
