pytorch tf roberta fill-mask sk arxiv:2107.10042 transformers Slovak KKY FAV license:cc-by-nc-sa-4.0 autotrain_compatible
---
language: "sk"
tags:
- Slovak
- KKY
- FAV
license: "cc-by-nc-sa-4.0"
---

# FERNET-News_sk
FERNET-News_sk is a monolingual Slovak RoBERTa-base model pre-trained from 4.5GB of thoroughly cleaned Slovak news corpus.

It is a Slovak version of our Czech [FERNET-News](https://huggingface.co/fav-kky/FERNET-News) model.

Preprint of our paper is available at https://arxiv.org/abs/2107.10042.