When analyzing traffic to some of my sites, I almost always notice a large amount of traffic from obscure sources like Japan, Russia, and other countries that really have no business visiting my site(s).Most of the time, these visitors are viewing the site(s) considerably more than other visitors that appear to be legitimate.Are these bots that index my site(s) or are they malicious by nature and should be banned using an IP deny filter?Also, is there a better way to handle these visitors so that I can both determine their intention(s) and herd them away from my site(s)?EDIT:If I can't determine the intention(s) of these visitors by using all available resources, would it be a bad idea (in terms of SEO) to create a page/section of my site(s) that, if visited, would tell me without a doubt that the visitors are bots (not robots, but bots that pry the site to expose flaws)?
How do you determine when to block an IP address or range of addresses?
web crawlers;ip address;visitors;bandwidth;international