Prevent Mail pop up automatically when there's a new email
IF you go to Notifications > Mail you should be able to change the Mail Alert Style to "None" to avoid mail alerts altogether.

Source: https://discussions.apple.com/thread/4306641