title: Get real URL for a POST operation
body: <p>I'm trying to crawl a website which returns me a file to download by clicking a button. I'm trying to use Chrome debug tool only get this and couldn't not figure out how to restore a real URL behind the POST action:</p>
  
  <p>Request Headers:</p>
  
  <pre><code>POST /download.php HTTP/1.1
  Host: www.rmdown.com
  Connection: keep-alive
  Content-Length: 385
  Cache-Control: no-cache
  Pragma: no-cache
  Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
  Origin: http://www.rmdown.com
  User-Agent: Mozilla/5.0 (X11; Linux i686) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1500.52 Safari/537.36
  Content-Type: multipart/form-data; boundary=----WebKitFormBoundaryeqA3pQupG0ndfLMZ
  Referer: http://www.rmdown.com/link.php?hash=1333f4f84bb41d5adc0f61e8f5a4658460da70b2737
  Accept-Encoding: gzip,deflate,sdch
  Accept-Language: zh-CN,zh;q=0.8,en-US;q=0.6,en;q=0.4
  </code></pre>
  
  <p>Request Payload:</p>
  
  <pre><code>------WebKitFormBoundaryeqA3pQupG0ndfLMZ
  Content-Disposition: form-data; name="ref"
  
  1333f4f84bb41d5adc0f61e8f5a4658460da70b2737
  ------WebKitFormBoundaryeqA3pQupG0ndfLMZ
  Content-Disposition: form-data; name="reff"
  
  MTM3OTQ4NzQwMQ==
  ------WebKitFormBoundaryeqA3pQupG0ndfLMZ
  Content-Disposition: form-data; name="submit"
  
  download
  ------WebKitFormBoundaryeqA3pQupG0ndfLMZ--
  </code></pre>
  
  <p>Response Headers</p>
  
  <pre><code>HTTP/1.1 200 OK
  Date: Wed, 18 Sep 2013 07:35:53 GMT
  Server: Apache/2.2.15 (CentOS)
  X-Powered-By: PHP/5.3.3
  Content-Disposition: attachment; filename="3f4f84bb41d5adc0f61e8f5a4658460da70b2737.torrent"
  Vary: Accept-Encoding
  Content-Encoding: gzip
  Content-Length: 43428
  Connection: close
  Content-Type: application/force-download
  </code></pre>
  
  <p>Any idea?</p>