# Overview

<p align="center">
  <img src="https://avatars.githubusercontent.com/u/12619994?s=200&v=4" width="150">
</p>

<!-- -------------------------------------------------------------------------------- -->

JABER (Junior Arabic BERt) is a 12-layer Arabic pretrained Language Model. 
JABER obtained rank one on [ALUE leaderboard](https://www.alue.org/leaderboard) at `01/09/2021`. 
This model is **only compatible** with the code in [this github repo](https://github.com/huawei-noah/Pretrained-Language-Model/tree/master/JABER-PyTorch) (not supported by the [Transformers](https://github.com/huggingface/transformers) library)
 
## Citation

Please cite the following [paper](https://arxiv.org/abs/2112.04329) when using our code and model:

``` bibtex
@misc{ghaddar2021jaber,
      title={JABER: Junior Arabic BERt}, 
      author={Abbas Ghaddar and Yimeng Wu and Ahmad Rashid and Khalil Bibi and Mehdi Rezagholizadeh and Chao Xing and Yasheng Wang and Duan Xinyu and Zhefeng Wang and Baoxing Huai and Xin Jiang and Qun Liu and Philippe Langlais},
      year={2021},
      eprint={2112.04329},
      archivePrefix={arXiv},
      primaryClass={cs.CL}
}
```
{}
pytorch arxiv:2112.04329 region:us
TAGS
#pytorch #arxiv-2112.04329 #region-us 

# Overview

<p align="center">
  <img src="URL width="150">
</p>



JABER (Junior Arabic BERt) is a 12-layer Arabic pretrained Language Model. 
JABER obtained rank one on ALUE leaderboard at '01/09/2021'. 
This model is only compatible with the code in this github repo (not supported by the Transformers library)
 
Please cite the following paper when using our code and model:


# Overview

<p align="center">
  <img src="URL width="150">
</p>



JABER (Junior Arabic BERt) is a 12-layer Arabic pretrained Language Model. 
JABER obtained rank one on ALUE leaderboard at '01/09/2021'. 
This model is only compatible with the code in this github repo (not supported by the Transformers library)
 
Please cite the following paper when using our code and model:
TAGS
#pytorch #arxiv-2112.04329 #region-us 
 # Overview

<p align="center">
  <img src="URL width="150">
</p>



JABER (Junior Arabic BERt) is a 12-layer Arabic pretrained Language Model. 
JABER obtained rank one on ALUE leaderboard at '01/09/2021'. 
This model is only compatible with the code in this github repo (not supported by the Transformers library)
 
Please cite the following paper when using our code and model:
passage: TAGS
#pytorch #arxiv-2112.04329 #region-us 
# Overview

<p align="center">
  <img src="URL width="150">
</p>



JABER (Junior Arabic BERt) is a 12-layer Arabic pretrained Language Model. 
JABER obtained rank one on ALUE leaderboard at '01/09/2021'. 
This model is only compatible with the code in this github repo (not supported by the Transformers library)
 
Please cite the following paper when using our code and model: