Redirecting crawlers
<p>I have an online tool that keeps track of tasks and users completing tasks. As a part of the process I record <code>$_SERVER['HTTP_USER_AGENT']</code>. However, once in a while I get visits from various bots and crawlers. How do I gently redirect them elsewhere without "hurting their feelings"?</p>

<p>I was thinking I'd net to build an array with bot names and run each AGENT info against it, and if found in array, redirect.</p>

<p>Is there a better way of doing it?  </p>
