Smart Automatic Scraping
<p>I have this problem, I need to scrape lots of different HTML data sources, each data source contains a table with lots of rows, for example country name, phone number, price per minute.</p>

<p>I would like to build some semi automatic scraper which will try to ..</p>

<ol>
<li><p>find automatically the right table in the HTML page,
-- probably by searching the text for some sample data and trying to find the common HTML element which contain both </p></li>
<li><p>extract the rows 
-- by looking at above two elements and selecting the same patten</p></li>
<li><p>identify which column contains what
-- by using some fuzzy algorithm to best guess which column is what.</p></li>
<li><p>export it to some python / other list
-- cleaning everytihng.</p></li>
</ol>

<p>does this look like a good design ? what tools would you choose to do it in if you program in python ?</p>
