
# deberta-small-japanese-aozora

## Model Description

This is a DeBERTa(V2) model pre-trained on 青空文庫 texts. NVIDIA A100-SXM4-40GB took 6 hours 42 minutes for training. You can fine-tune `deberta-small-japanese-aozora` for downstream tasks, such as [POS-tagging](https://huggingface.co/KoichiYasuoka/deberta-small-japanese-luw-upos), dependency-parsing, and so on.

## How to Use

```py
from transformers import AutoTokenizer,AutoModelForMaskedLM
tokenizer=AutoTokenizer.from_pretrained("KoichiYasuoka/deberta-small-japanese-aozora")
model=AutoModelForMaskedLM.from_pretrained("KoichiYasuoka/deberta-small-japanese-aozora")
```


{"language": ["ja"], "license": "cc-by-sa-4.0", "tags": ["japanese", "masked-lm"], "pipeline_tag": "fill-mask", "mask_token": "[MASK]", "widget": [{"text": "\u65e5\u672c\u306b\u7740\u3044\u305f\u3089[MASK]\u3092\u8a2a\u306d\u306a\u3055\u3044\u3002"}]}
transformers pytorch deberta-v2 fill-mask japanese masked-lm ja license:cc-by-sa-4.0 autotrain_compatible endpoints_compatible region:us
TAGS
#transformers #pytorch #deberta-v2 #fill-mask #japanese #masked-lm #ja #license-cc-by-sa-4.0 #autotrain_compatible #endpoints_compatible #region-us 


# deberta-small-japanese-aozora

## Model Description

This is a DeBERTa(V2) model pre-trained on 青空文庫 texts. NVIDIA A100-SXM4-40GB took 6 hours 42 minutes for training. You can fine-tune 'deberta-small-japanese-aozora' for downstream tasks, such as POS-tagging, dependency-parsing, and so on.

## How to Use




# deberta-small-japanese-aozora ## Model Description

This is a DeBERTa(V2) model pre-trained on 青空文庫 texts. NVIDIA A100-SXM4-40GB took 6 hours 42 minutes for training. You can fine-tune 'deberta-small-japanese-aozora' for downstream tasks, such as POS-tagging, dependency-parsing, and so on. ## How to Use
TAGS
#transformers #pytorch #deberta-v2 #fill-mask #japanese #masked-lm #ja #license-cc-by-sa-4.0 #autotrain_compatible #endpoints_compatible #region-us 
 # deberta-small-japanese-aozora ## Model Description

This is a DeBERTa(V2) model pre-trained on 青空文庫 texts. NVIDIA A100-SXM4-40GB took 6 hours 42 minutes for training. You can fine-tune 'deberta-small-japanese-aozora' for downstream tasks, such as POS-tagging, dependency-parsing, and so on. ## How to Use
passage: TAGS
#transformers #pytorch #deberta-v2 #fill-mask #japanese #masked-lm #ja #license-cc-by-sa-4.0 #autotrain_compatible #endpoints_compatible #region-us 
# deberta-small-japanese-aozora## Model Description

This is a DeBERTa(V2) model pre-trained on 青空文庫 texts. NVIDIA A100-SXM4-40GB took 6 hours 42 minutes for training. You can fine-tune 'deberta-small-japanese-aozora' for downstream tasks, such as POS-tagging, dependency-parsing, and so on.## How to Use