title: Python data scraping with Scrapy
body: <p>I want to scrape data from a website which has TextFields, Buttons etc.. and my requirement is to fill the text fields and submit the form to get the results and then scrape the data points from results page.</p>
  
  <p>I want to know that does Scrapy has this feature or If anyone can recommend a library in Python to accomplish this task?</p>
  
  <p>(edited)<br/>
  I want to scrape the data from the following website:<br/>
  <a href="http://a836-acris.nyc.gov/DS/DocumentSearch/DocumentType">http://a836-acris.nyc.gov/DS/DocumentSearch/DocumentType</a><br/></p>
  
  <p>My requirement is to select the values from ComboBoxes and hit the search button and scrape the data points from the result page.</p>
  
  <p>P.S. I'm using selenium Firefox driver to scrape data from some other website but that solution is not good because selenium Firefox driver is dependent on FireFox's EXE i.e Firefox must be installed before running the scraper.
  <br/><br/>
  Selenium Firefox driver is consuming around 100MB memory for one instance and my requirement is to run a lot of instances at a time to make the scraping process quick so there is memory limitation as well.
  <br/><br/>
  Firefox crashes sometimes during the execution of scraper, don't know why. Also I need window less scraping which is not possible in case of Selenium Firefox driver.
  <br/><br/>
  My ultimate goal is to run the scrapers on Heroku and I have Linux environment over there so selenium Firefox driver won't work on Heroku.
  Thanks</p>