Empty Image renders in front of transparent object
I was trying to make the mesh transparent, but it seems the easier way is to make the images transparent. In the image's object data panel, click the "Use Alpha" checkbox, and adjust the transparency value. To get the desired effect, this needs to be set on the image and you need to set an alpha on the mesh's material's "viewport display" like I showed in the question.