pytorch bert zh arxiv:2205.00258 transformers license:apache-2.0 fill-mask
---
language: zh
pipeline_tag: fill-mask
widget:
- text: "中国的首都是北[MASK]。"
- text: "牛奶是[MASK]色的。"
tags:
- bert
license: apache-2.0
---
## Alibaba PAI BERT Tiny Chinese

This project provides Chinese pre-trained language models and various types of NLP tools. The models are pre-trained on the large-scale corpora hosted by the Alibaba PAI team. It is developed based on the EasyNLP framework (https://github.com/alibaba/EasyNLP).
## Citation

If you find the resource is useful, please cite the following paper in your work:
```
@article{easynlp, 
title = {EasyNLP: A Comprehensive and Easy-to-use Toolkit for Natural Language Processing},
publisher = {arXiv}, 
author = {Wang, Chengyu and Qiu, Minghui and Zhang, Taolin and Liu, Tingting and Li, Lei and Wang, Jianing and Wang, Ming and Huang, Jun and Lin, Wei}, 
url = {https://arxiv.org/abs/2205.00258}, 
year = {2022} 
} 
```