Ngram based Langauge Models learned using an Encoder-Decoder Model
For your case, I feel that skip-gram model will be fit for your business problem. Where u can predict a sequence of a word rather than one word. I recommend you to train the skiagram model on your corpus.