sentence1: we adopt pretrained embeddings for word forms with the provided training data by word2vec .
sentence2: in addition to that we use pre-trained embeddings , by training word2vec skip-gram model on wikipedia texts .