Alpha not showing up in renders for textures painted with transparent png
Thanks to @brockmann's hint I was able to resolve this issue. It was just a matter of connecting the alpha channel of the image node (got to shading tab) to the alpha input of the material node as such:
before:

after:

Apparently Evee does not render this correctly, so I needed to switch to cycles to see how it looks!