title: How to Crawling these script in python
body: <p>For the very first time, I tried to use BeautifulSoup for crawling HTML.</p>
  <p>The part that I wanted to crawl was below the picture(red box).</p>
  <p><a href="https://i.stack.imgur.com/FlJEg.png" rel="nofollow noreferrer">enter image description here</a></p>
  <p>So I make a code to using <em>request</em> and <em>bs</em>, like this.</p>
  <pre><code>    response = requests.get(Url_Front+str(url)+Url_End).text
      
      soup = bs(response)
  
      print(respone)
  
  </code></pre>
  <p>but the result seems like this...</p>
  <pre><code>&lt;script src=&quot;/sijangtong/js/jquery/jquery-1.8.1.js&quot; type=&quot;text/javascript&quot;&gt;&lt;/script&gt;
  &lt;script src=&quot;/sijangtong/js/jquery/jquery-ui.js&quot; type=&quot;text/javascript&quot;&gt;&lt;/script&gt;
  &lt;script src=&quot;/sijangtong/js/jquery/form/jquery.form.js&quot; type=&quot;text/javascript&quot;&gt;&lt;/script&gt;
  &lt;script src=&quot;/sijangtong/js/jquery/jquery.cookie.js&quot; type=&quot;text/javascript&quot;&gt;&lt;/script&gt;  
  &lt;script src=&quot;/sijangtong/js/jquery/dynatree/jquery.dynatree.js&quot; type=&quot;text/javascript&quot; &gt;&lt;/script&gt;
  &lt;script src=&quot;/sijangtong/js/jquery/simplemodal/jquery.simplemodal-1.4.3.js&quot; type=&quot;text/javascript&quot; &gt;&lt;/script&gt;
  &lt;script src=&quot;/sijangtong/js/sijang/sijang_comm.js&quot; type=&quot;text/javascript&quot; &gt;&lt;/script&gt;
  &lt;script src=&quot;/sijangtong/js/sijang/sijang_util.js&quot; type=&quot;text/javascript&quot; &gt;&lt;/script&gt;
  
  </code></pre>
  <p>Tons of time spending noticed that it has to use 'Selenium'.</p>
  <pre><code>
  import requests
  from bs4 import BeautifulSoup as bs  # HTML parser library
  from selenium import webdriver  # web crawling for javascript
  
  for url in Url_Number:
      driver = webdriver.Chrome('C:\Python_Study\chromedriver.exe.')
      driver.implicitly_wait(3)
      Real_url = Url_Front+str(url)+Url_End
      driver.get(Real_url)
      div_elements = driver.find_elements_by_xpath('//*[@id=&quot;onnuriShopPopList&quot;]/table/tbody/tr[1]/td/table/tbody')
  
      for my_div_elements in div_elements:
          print(my_div_elements.get_attribute(&quot;table&quot;))
  driver.quit()
  </code></pre>
  <p>The result seems like this.</p>
  <blockquote>
  <p>runfile('C:/Users/rlatj/.spyder-py3/temp.py', wdir='C:/Users/rlatj/.spyder-py3')
  None</p>
  </blockquote>
  <p>Actually, I don't know where I have to fix it.</p>
  <ol>
  <li>Am I having the right concept of HTML and selenium?</li>
  </ol>
  <blockquote>
  <p>My concept: selenium is able to crawl javascript parser in HTML.</p>
  </blockquote>
  <ol start="2">
  <li>Why the result is 'None'?</li>
  </ol>