How can I use Google Play without storing any Google account information on my phone?
Beyond what you've already done, you can't.  The Market requires you to have your Google Account added to your phone, and this naturally stores data such as your email address even if you don't sync email.