Why are "Transformers" called this way?
The authors of the original paper don't provide an explanation, but I suspect it's a combination of:

popular recognizable branding (cf. BERT, DALL-E, Watson etc)
similarity to [sequence] transduction / translation / transformations generally