pytorch gpt2 text-generation ko transformers korean lassl license:apache-2.0
---
license: apache-2.0
language: ko
tags:
  - korean
  - lassl

---

# LASSL gpt2-ko-small
## How to use

```python
from transformers import AutoModel, AutoTokenizer
model = AutoModel.from_pretrained("lassl/gpt2-ko-small")
tokenizer = AutoTokenizer.from_pretrained("lassl/gpt2-ko-small")
```

## Evaluation
Evaulation results will be released soon.

## Corpora
This model was trained from 6,831,079 examples (whose have 3,497,512,448 tokens). 6,831,079 examples are extracted from below corpora. If you want to get information for training, you should see `config.json`.  

```bash
corpora/
├── [707M]  kowiki_latest.txt
├── [ 26M]  modu_dialogue_v1.2.txt
├── [1.3G]  modu_news_v1.1.txt
├── [9.7G]  modu_news_v2.0.txt
├── [ 15M]  modu_np_v1.1.txt
├── [1008M]  modu_spoken_v1.2.txt
├── [6.5G]  modu_written_v1.0.txt
└── [413M]  petition.txt
```


