title: http response codes - broken links automated checker returning many working 0 responses
body: <p>I have set up a cron job that is running through a large site and finding links. we then test for http response codes occasionally looking for codes = 0 or codes > 499. </p>
  
  <p>The problem is I am getting a lot of http response codes 0 for pages that exist perfectly fine. on the other hand, i think it is important to have the 0 code for a website that has been completely removed isn't it?</p>
  
  <p>Hope someone can advise! Thanks!</p>