title: Scraping javascript-generated data using Python
body: <p>I want to scrape some data of following url using Python.
  <a href="http://www.hankyung.com/stockplus/main.php?module=stock&amp;mode=stock_analysis_infomation&amp;itemcode=078340" rel="noreferrer">http://www.hankyung.com/stockplus/main.php?module=stock&amp;mode=stock_analysis_infomation&amp;itemcode=078340</a></p>
  
  <p>It's about a summary of company information. </p>
  
  <p>What I want to scrape is not shown on the first page. 
  By clicking tab named "재무제표", you can access financial statement. And clicking tab named "현금흐름표', you can access "Cash Flow". </p>
  
  <p>I want to scrape the "Cash Flow" data. </p>
  
  <p>However, Cash flow data is generated by javascript across the url.
  The following link is that url which is hidden, <a href="http://stock.kisline.com/compinfo/financial/main.action?vhead=N&amp;vfoot=N&amp;vstay=&amp;omit=&amp;vwidth=" rel="noreferrer">http://stock.kisline.com/compinfo/financial/main.action?vhead=N&amp;vfoot=N&amp;vstay=&amp;omit=&amp;vwidth=</a></p>
  
  <p>Cash flow data is generated by submitting some option value and cookie to this url.</p>
  
  <p>As you perceived, itemcode=078340 in the first link means stock code and there are as many as 1680 stocks that I want gather cash flow data. I want make it a loop structure.</p>
  
  <p>Is there good way to scrape cash flow data?
  I tried scrapy but scrapy is difficult to cope with my another scraping code already I'm using.</p>