How to retrain Glove Vectors on top of my own data?
What you should do is:


Create a new instance of a GloVe model with the old_words and new_words as vocabulary.
Replace the initial vectors/biases of the old_words with the ones you have already.
Train this model on mydata.txt.


The new old_words representations won't be the same but will be highly influenced by the old ones.