deactivate growlmail rss notification
If you want just notifications on the new mails you have in your Inbox(es), then there is a setting for that in GrowlMail configuration tab. Not in Growl System Preferences, but in Mail.app Growl Mail preferences.