sentence1: we initialize our word representation using publicly available word2vec trained on google news dataset and keep them fixed during training .
sentence2: we train 300 dimensional word embedding using word2vec on all the training data , and fine-turning during the training process .