
# Transformer language model for Croatian and Serbian

Trained on 28GB datasets that contain Croatian and Serbian language for one epochs (3 mil. steps).
Leipzig Corpus, OSCAR, srWac, hrWac, cc100-hr and cc100-sr  datasets

| Model                          | #params                        | Arch. | Training data                     |
|--------------------------------|--------------------------------|-------|-----------------------------------|
| `Andrija/SRoBERTa-XL` | 80M   | Forth | Leipzig Corpus, OSCAR, srWac, hrWac, cc100-hr and cc100-sr  (28 GB of text)            |
{"language": ["hr", "sr", "multilingual"], "license": "apache-2.0", "tags": ["masked-lm"], "datasets": ["oscar", "srwac", "leipzig", "cc100", "hrwac"], "widget": [{"text": "Ovo je po\u010detak <mask>."}]}
transformers pytorch roberta fill-mask masked-lm hr sr multilingual dataset:oscar dataset:srwac dataset:leipzig dataset:cc100 dataset:hrwac license:apache-2.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #roberta #fill-mask #masked-lm #hr #sr #multilingual #dataset-oscar #dataset-srwac #dataset-leipzig #dataset-cc100 #dataset-hrwac #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 

Transformer language model for Croatian and Serbian
===================================================


Trained on 28GB datasets that contain Croatian and Serbian language for one epochs (3 mil. steps).
Leipzig Corpus, OSCAR, srWac, hrWac, cc100-hr and cc100-sr datasets




TAGS
#transformers #pytorch #roberta #fill-mask #masked-lm #hr #sr #multilingual #dataset-oscar #dataset-srwac #dataset-leipzig #dataset-cc100 #dataset-hrwac #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 

passage: TAGS
#transformers #pytorch #roberta #fill-mask #masked-lm #hr #sr #multilingual #dataset-oscar #dataset-srwac #dataset-leipzig #dataset-cc100 #dataset-hrwac #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 
