How to add a pretrained model to my layers to get embeddings?
I think you should use Keras embedding layer. It will be too easier than what you are doing.

Steps


Create Embedding Matrix
add matrix to embedding layer while building model.


You will find detailed article

https://www.cs.uaf.edu/2011/spring/cs641/lecture/04_05_modeling.html