How to save "complete webpage" not just basic html using Python
Question: I am using following code to save webpage using Python:

    
    
    import urllib
    import sys
    from bs4 import BeautifulSoup
    
    url = 'http://www.vodafone.de/privat/tarife/red-smartphone-tarife.html'
    f = urllib.urlretrieve(url,'test.html')
    

**Problem** : This code saves html as basic html without javascripts, images
etc. I want to save webpage as complete (Like we have option in browser)

**Update** : I am using following code now to save all the js/images/css files
of webapge so that it can be saved as complete webpage but still my output
html is getting saved like basic html:

    
    
    import pycurl
    import StringIO
    
    c = pycurl.Curl()
    c.setopt(pycurl.URL, "http://www.vodafone.de/privat/tarife/red-smartphone-tarife.html")
    
    b = StringIO.StringIO()
    c.setopt(pycurl.WRITEFUNCTION, b.write)
    c.setopt(pycurl.FOLLOWLOCATION, 1)
    c.setopt(pycurl.MAXREDIRS, 5)
    c.perform()
    html = b.getvalue()
    #print html
    fh = open("file.html", "w")
    fh.write(html)
    fh.close()
    


Answer: Try emulating your browser with
[selenium](http://pypi.python.org/pypi/selenium). This script will pop up the
`save as` dialog for the webpage. You will still have to figure out how to
emulate pressing enter for download to start as the file dialog is out of
selenium's reach (how you do it is also OS dependent).

    
    
    from selenium import webdriver
    from selenium.webdriver.common.action_chains import ActionChains
    from selenium.webdriver.common.keys import Keys
    
    br = webdriver.Firefox()
    br.get('http://www.google.com/')
    
    save_me = ActionChains(br).key_down(Keys.CONTROL)\
             .key_down('s').key_up(Keys.CONTROL).key_up('s')
    save_me.perform()
    

Also I think following _@Amber_ suggestion of grabbing the the linked
resources may be a simpler, thus a better solution. Still, I think using
selenium is a good starting point as `br.page_souce` will get you the entire
dom along with the dynamic content generated by javascript.

