Composite output window differs from viewer
It appears you are using blender 2.8. In blender 2.92, the set alpha node is updated to allow apply mask mode. To fix this, drop an alpha convert node after the set alpha node. Make sure it is set to convert straight to premul. That should fix your alpha problem.