Since macOS update 10.15.4, I have been having a problem with Safari. 

When I open Safari on one desktop/Space and switch to another one, after a short delay of approximately a second Safari steals focus and swaps Spaces back to the one where it is open. No matter how many times I change the space I'm using, it keeps reverting back to the one where safari is open.

Any ideas on what might be causing this, or how I can fix it? I use Spaces a lot for my workflow and this basically renders them unusable while safari is open.