Another problem we face is that the BERT model released by Google is trained only on Arabic Wikipedia, which is almost exclusively Modern Standard Arabic (MSA). The shared task dataset contains 5,030 tweets related to different political issues and events in the Middle East taking place between 2011 and 2018. Tweets involve both MSA as well as dialects at various degrees of granularity such as Egyptian, Gulf, and Levantine. 
 Question: What dialect is used in the Google BERT model and what is used in the task data?
Modern Standard Arabic (MSA) MSA as well as dialects at various degrees of granularity such as Egyptian, Gulf, and Levantine