Predict customer behaviour with Transformer(attention is all you need)
Definitely, it is a good idea and has been attempted before.
Have a look at Alibaba's paper which uses transformers:
https://www.kdnuggets.com/2019/08/order-matters-alibabas-transformer-based-recommender-system.html
https://arxiv.org/abs/1905.06874
There are also various other papers that use other types of seq2seq for recommender systems.