q?=admin page accessible for anonymous
Check the user permissions. The anonymous role might have one too many permissions granting access, such as "Use the administration pages and help".

You aren't running any sort of caching setups that might be caching a logged in experience and displaying it for anonymous users are you?