How to get vector representations(or embeddings) of time series?
Maybe the framework of Neural Processes could be interesting here? It defines a  family of functions parameterized by a neural network. The parameters could serve as your embeddings, eventually after projecting into a lower dimension. See the paper Attentive Neural Processes and the preceding papers cited therein.