title: BERT multilingual model - For classification
body: <p>I am trying to build multilingual classification model with BERT.</p>
  
  <p>I'm using a feature-based approach (concatenating the features from top-4 hidden layers) and building a CNN classifier on top of that.</p>
  
  <p>After that I'm using different language (say chinese) from the same domain for testing, but accuracy for these languages is near zero.</p>
  
  <p>I am not sure that I understand paper well, so here is my question:</p>
  
  <p>Is it possible to fine-tune BERT multilingual model on one language
  (e.g. English) or use feature-based approach to extract the features and build classifer, and after that use this model for different languages (other
  languages from the list of supported languages in documentation of
  BERT)?</p>
  
  <p>Also, is my hypothesis, "regarding BERT that it maps I think that it's embedding layer maps words from different languages with same context to similar clusters", correct?</p>