# Transformer language model for Croatian and Serbian
Trained on 0.7GB dataset Croatian and Serbian language for one epoch.
Dataset from Leipzig Corpora.

# Information of dataset
| Model                          | #params                        | Arch. | Training data                     |
|--------------------------------|--------------------------------|-------|-----------------------------------|
| `Andrija/SRoBERTa` | 120M   | First  | Leipzig Corpus (0.7 GB of text)            |


# How to use in code
```python
from transformers import AutoTokenizer, AutoModelForMaskedLM
  
tokenizer = AutoTokenizer.from_pretrained("Andrija/SRoBERTa")

model = AutoModelForMaskedLM.from_pretrained("Andrija/SRoBERTa")
```
{"language": ["hr", "sr", "multilingual"], "license": "apache-2.0", "tags": ["masked-lm"], "datasets": ["leipzig"], "widget": [{"text": "Gde je <mask>."}]}
transformers pytorch roberta fill-mask masked-lm hr sr multilingual dataset:leipzig license:apache-2.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #roberta #fill-mask #masked-lm #hr #sr #multilingual #dataset-leipzig #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 

Transformer language model for Croatian and Serbian
===================================================


Trained on 0.7GB dataset Croatian and Serbian language for one epoch.
Dataset from Leipzig Corpora.


Information of dataset
======================



How to use in code
==================



TAGS
#transformers #pytorch #roberta #fill-mask #masked-lm #hr #sr #multilingual #dataset-leipzig #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 

passage: TAGS
#transformers #pytorch #roberta #fill-mask #masked-lm #hr #sr #multilingual #dataset-leipzig #license-apache-2.0 #autotrain_compatible #endpoints_compatible #region-us 
