A way to init sentence embedding for unsupervised text clustering, better than glove wordvec?
Generally, combining word vectors in a single sentence / document representation does not work extremely well, although the average embedding has been used in fastText and pooling in this paper.
You can also use autoencoders to try and predict the word distribution, similar to a bag-of-words approach, like here.