When URLs no longer exist on my site, I give a page and issue an HTTP 410 status (the GONE error). I created a script that allows my co-administrator to add and remove pictures from the site and when pictures are removed, that picture page will instead produce an error page and return an HTTP 410 status code to the browser and within approximately five seconds, the sitemaps are updated to reflect the changes.I also have every page set with the robots noarchive metatag like so:<meta name=GOOGLEBOT content=NOARCHIVE><meta name=ROBOTS content=NOARCHIVE>Everyday when I visit webmaster tools, I get a random number of error URLs all pointing to the photo pages. Even though google is correct at stating they return 410 status code, URLs still appear in webmaster tools even though the co-adminstrator removed the photo pages through the script and thus all links on the site to the affected URLs as well as all references to the affected URLs from the sitemaps are removed.I also noticed that the more errors google sees on my site (regardless of whether the status codes are 404 or 410) the less I make in adsense.I also have configured googlebot to make a max of 10 requests per second (slider all the way to the right).What can I do to lower the odds of google seeing the newly generated error URLs as a result of removing bad pictures from the site so that I don't see 410 status codes in webmaster tools?
Forcing google to rescan sitemaps instantly
google;sitemap;googlebot;error;410 gone