How can I build a seq2seq model , which is topic aware
Try this approach (not embedded but filtering your model) with Topic modeling, that could be used to filter the results of your model by topic:


Separate each doc in several sentences
Obtain the best topics ( occur > 3, chars > 3 ) from sentences if you do not have an idea of topics to declare (LatentDirichlet Allocation)
Discard some topics out of interest


Finally assign a dominant topic to every sentence and filter results by topic.

I have found a reference from steps 1-3:
https://medium.com/@actsusanli/when-topic-modeling-is-part-of-the-text-pre-processing-294b58d35514