
# TajBERTo: RoBERTa-like Language model trained on Tajik 
## First ever Tajik NLP model 🔥



# Dataset:
# This model was trained on filtered and merged version of Leipzig Corpora https://wortschatz.unileipzig.de/en/download/Tajik 

## Intended use 
# You can use the raw model for masked text generation or fine-tune it to a downstream task. 


## Example pipeline
```python
from transformers import pipeline
fill_mask = pipeline(
    "fill-mask",
    model="muhtasham/TajBERTo",
    tokenizer="muhtasham/TajBERTo"
)
fill_mask("Пойтахти <mask> Душанбе")

# This is the beginning of a beautiful <mask>.

{'score': 0.1952248513698578,
  'sequence': 'Пойтахти шаҳри Душанбе',
  'token': 710,
  'token_str': ' шаҳри'},
 {'score': 0.029092855751514435,
  'sequence': 'Пойтахти дар Душанбе',
  'token': 310,
  'token_str': ' дар'},
 {'score': 0.020065447315573692,
  'sequence': 'Пойтахти Душанбе Душанбе',
  'token': 717,
  'token_str': ' Душанбе'},
 {'score': 0.016725927591323853,
  'sequence': 'Пойтахти Тоҷикистон Душанбе',
  'token': 424,
  'token_str': ' Тоҷикистон'},
 {'score': 0.011400512419641018,
  'sequence': 'Пойтахти аз Душанбе',
  'token': 335,
  'token_str': ' аз'}
  
```


 
{"language": ["tg"], "tags": ["generated_from_trainer"], "widget": [{"text": "\u041f\u043e\u0439\u0442\u0430\u0445\u0442\u0438 <mask> \u0414\u0443\u0448\u0430\u043d\u0431\u0435"}, {"text": "<mask> \u0431\u0430 \u0438\u043d \u0441\u0430\u0439\u0442\u0438 \u0448\u0443\u043c\u043e \u043c\u0435\u0434\u0430\u0440\u043e\u044f\u043c."}, {"text": "\u041d\u043e\u043c\u0438 \u043c\u0430\u043d \u0410\u043a\u0440\u0430\u043c <mask>"}], "model_index": [{"name": "TajBERTo", "results": [{"task": {"name": "Masked Language Modeling", "type": "fill-mask"}}]}]}
transformers pytorch tensorboard safetensors roberta fill-mask generated_from_trainer tg autotrain_compatible endpoints_compatible has_space region:us
TAGS
#transformers #pytorch #tensorboard #safetensors #roberta #fill-mask #generated_from_trainer #tg #autotrain_compatible #endpoints_compatible #has_space #region-us 


# TajBERTo: RoBERTa-like Language model trained on Tajik 
## First ever Tajik NLP model 



# Dataset:
# This model was trained on filtered and merged version of Leipzig Corpora URL 

## Intended use 
# You can use the raw model for masked text generation or fine-tune it to a downstream task. 


## Example pipeline



 
# TajBERTo: RoBERTa-like Language model trained on Tajik ## First ever Tajik NLP model # Dataset: # This model was trained on filtered and merged version of Leipzig Corpora URL ## Intended use # You can use the raw model for masked text generation or fine-tune it to a downstream task. ## Example pipeline
TAGS
#transformers #pytorch #tensorboard #safetensors #roberta #fill-mask #generated_from_trainer #tg #autotrain_compatible #endpoints_compatible #has_space #region-us 
 # TajBERTo: RoBERTa-like Language model trained on Tajik ## First ever Tajik NLP model # Dataset: # This model was trained on filtered and merged version of Leipzig Corpora URL ## Intended use # You can use the raw model for masked text generation or fine-tune it to a downstream task. ## Example pipeline
passage: TAGS
#transformers #pytorch #tensorboard #safetensors #roberta #fill-mask #generated_from_trainer #tg #autotrain_compatible #endpoints_compatible #has_space #region-us 
# TajBERTo: RoBERTa-like Language model trained on Tajik## First ever Tajik NLP model# Dataset:# This model was trained on filtered and merged version of Leipzig Corpora URL## Intended use# You can use the raw model for masked text generation or fine-tune it to a downstream task.## Example pipeline