title: HTML content extraction using Diffbot
body: <p>Can someone help me I want to extract html data from <a href="http://www.quranexplorer.com/Hadith/English/Index.html" rel="nofollow">http://www.quranexplorer.com/Hadith/English/Index.html</a>. I have found a service that does exactly that <a href="http://diffbot.com/dev/docs/" rel="nofollow">http://diffbot.com/dev/docs/</a> they support data extraction via a simple api, the problem it that I have a large number of url that needs that needs to be processed. The link below <a href="http://test.deen-ul-islam.org/html/h.js" rel="nofollow">http://test.deen-ul-islam.org/html/h.js</a></p>
  
  <p>I need to create  a script that that follows the url then using the api generate the json format of the html data (the apis from the site allows batch requests check website docs) </p>
  
  <p>Please note diffbot only allows 10000 free request per month so I need a way to save the progress and be able to pick up where I left off. </p>
  
  <p>Here is an example I created using php.</p>
  
  <pre><code>$token = "dfoidjhku";// example token
  $url = "http://www.quranexplorer.com/Hadith/English/Hadith/bukhari/001.001.006.html";
  $geturl="http://www.diffbot.com/api/article?tags=1&amp;token=".$token."&amp;url=".$url;
  $json = file_get_contents($geturl);
  $data = json_decode($json, TRUE);
  echo $article_title=$data['title'];
  echo $article_author=$data['author'];
  echo $article_date=$data['date'];
  echo nl2br($article_text=$data['text']);
  $article_tags=$data['tags'];
  foreach($article_tags as $result) {
      echo $result, '&lt;br&gt;';
  }
  </code></pre>
  
  <p>I don't mind if the tool is in javascript or php  I just need a way to get the html data in json format. </p>