---
language: en-ru
license: apache-2.0
---
# XLM-RoBERTa large model (uncased) whole word masking finetuned on SQuAD
Pretrained model on English and Russian language using a masked language modeling (MLM) objective. It was introduced in
[this paper](https://arxiv.org/abs/1810.04805) and first released in
[this repository](https://github.com/google-research/bert). This model is uncased: it does not make a difference


## Used Datasets
SQuAD + SberQuAD

[SberQuAD original paper](https://arxiv.org/pdf/1912.09723.pdf) is here! Recommend to read!

## Evaluation results
The results obtained are the following (SberQUaD):
```
f1 = 84.3
exact_match = 65.3