Media images link to their own image
In: 
structure -> media types -> image -> display

/admin/structure/media/manage/image/display

the image field settings had 'Link image to' -> file

Set this to nothing, removed the theme image-formatter.html.twig template and the file link added to each image was no longer there.