How to disable auto load of applications on restart/turn on over OS X Catalina?
I know this isn't a permanent solution, but from what you are describing it only happens when you recently close an app and then restart your computer. Here is a screenshot from a support article on the Apple Support website  Along with this solution instead of closing the application, make sure that it is totally closed (the little white dot below the application is gone). 



For example: 
Application still open:  
Application totally closed: 


Let me know if any of this helps!