How can I get Mail.app notifications without keeping it running?
If you're just using Gmail (like OP), then you can use the program Gmail Notifr. It lives in your menubar, and checks Gmail at a specified interval, it also supports Growl notifications.