pytorch gpt2 text-generation ru transformers
---
language:
- ru
widget:
- text: "<IN>Как нам все-таки сделать AGI?\n<OUT>"
metrics:
- loss: 3.3
- perplexity: 25.7528
---

Start from sberbank-ai/rugpt3medium_based_on_gpt2 and finetuning on AGIRussia chats (russian).

On this moment - only 3 epoch (perplexity falls reasons)

on progress...
