overlay filter with simple PNG adds black fringe
Default pixel format for overlay filter is yuv420p. Use the format option in overlay to set it as auto or rgb.

ffmpeg -y -i b.png -i a.png -filter_complex "[0:v]format=rgba[a]; [1:v]format=rgba[b]; [a][b]overlay=format=auto" normal.png