Why are "Transformers" called this way? What is the reason behind the name &quot;Transformers&quot;, for Multi Head Self-Attention-based neural networks from Attention is All You Need?
I have been googling this question for a long time, and nowhere I can find any explanation.
The authors of the original paper don't provide an explanation, but I suspect it's a combination of:

popular recognizable branding (cf. BERT, DALL-E, Watson etc)
similarity to [sequence] transduction / translation / transformations generally