pytorch gpt2 text-generation ru transformers
---
language:
- ru
widget:
- text: "Немыслимо, "
metrics:
- loss: 3.3
- perplexity: 25.7528
---

Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Govard Phillips Lovecraft texts (russian).

On this moment - only 1 epoch (perplexity falls reasons)

on progress...

