1. A method for automatically extracting and structuring the data from a semi-structured web site, the method comprising: developing a set of experts; analyzing the links and pages on the website by means of the experts; identifying predetermined types of generic structures by means of the experts; clustering pages and text segments within the pages based on the identified structures; and identifying, based on the clustering, the semi-structured data that can be extracted.