
Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Biblie & preaching (russian).

On this moment - only 1 epoch, 1650 seq length

on progress...
{"language": ["ru"], "metrics": [{"loss": 3.3}, {"perplexity": 25.7528}], "widget": [{"text": "\u0411\u043e\u0433, \u044d\u0442\u043e "}]}
transformers pytorch safetensors gpt2 text-generation ru autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #ru #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


Start from sberbank-ai/rugpt3small_based_on_gpt2 and finetuning on Biblie & preaching (russian).

On this moment - only 1 epoch, 1650 seq length

on progress...
TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #ru #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

passage: TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #ru #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
