title: Crawling through pages with PostBack data javascript Python Scrapy
body: <p>I'm crawling through some directories with ASP.NET programming via Scrapy.</p>
  
  <p>The pages to crawl through are encoded as such:</p>
  
  <p><code>javascript:__doPostBack('ctl00$MainContent$List','Page$X')</code></p>
  
  <p>where X is an int between 1 and 180.  The MainContent argument is always the same.  I have no idea how to crawl into these.  I would love to add something to the SLE rules as simple as <code>allow=('Page$')</code> or <code>attrs='__doPostBack'</code>, but my guess is that I have to be trickier in order to pull the info from the javascript "link."</p>
  
  <p>If it's easier to "unmask" each of the absolute links from the javascript code and save those to a csv, then use that csv to load requests into a new scraper, that's okay, too.</p>