
Start from sberbank-ai/rugpt3medium_based_on_gpt2 and finetuning on AGIRussia chats (russian).

On this moment - only 3 epoch (perplexity falls reasons)

on progress...

{"language": ["ru"], "metrics": [{"loss": 3.3}, {"perplexity": 25.7528}], "widget": [{"text": "<IN>\u041a\u0430\u043a \u043d\u0430\u043c \u0432\u0441\u0435-\u0442\u0430\u043a\u0438 \u0441\u0434\u0435\u043b\u0430\u0442\u044c AGI?\n<OUT>"}]}
transformers pytorch safetensors gpt2 text-generation ru autotrain_compatible endpoints_compatible text-generation-inference region:us
TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #ru #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 


Start from sberbank-ai/rugpt3medium_based_on_gpt2 and finetuning on AGIRussia chats (russian).

On this moment - only 3 epoch (perplexity falls reasons)

on progress...

TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #ru #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 

passage: TAGS
#transformers #pytorch #safetensors #gpt2 #text-generation #ru #autotrain_compatible #endpoints_compatible #text-generation-inference #region-us 
