title: Check 500 error to by pass
body: <p>I use Scrapy framework to crawl data. My crawler will be interrupted if it encounters a 500 error. So I need to check an available link before I parse a web content.<br>
  Is there any approach to resolve my problem?<br>
  Thank you so much.</p>