My server has run out of memory a few times in the past two days, because of which the site crashed. I checked AWstats and found that hundreds of unresolved IP addresss have been logged, and the number of hits from them seems unreasonable:I'm going to ban the top 10 IP addresses as they all seem spammy to me. But there are other hundreds of IP addresses that seems to be causing thousands of hits, and I really don't know if they are legitimate request from users using browsers. I could ban all of them using htaccess, but that doesn't seem very practical nor is a long term solution. (The site gets around 3 million pageviews/month.)My questions are:How do I filter out legitimate users from unwanted bots or IP addresses that are scraping content?Should I go ahead and ban all unresolved IP addresses?Is there an automated way of banning spammy IP addresses?
Banning unresolved IP addresses
ip address