28. A non-transitory computer-readable medium, according to claim 16 , wherein executable code that performs clean up processing removes floating elements, link boxes, navigation panels, and videos from unknown sources.
16. A non-transitory computer-readable medium containing software that extracts principal content from Web pages, the software comprising: executable code that identifies and classifies items on the Web page; executable code that builds a list of candidates; executable code that calculates candidate scores that vary according to a plurality of weights assigned to paragraphs and images of the Web page, wherein a particular paragraph is provided with a first weight based on a number of lines in the particular paragraph and is provided with a second weight based on a number of words in the particular paragraph, the first weight being independent of the second weight and a particular image is provided with a weight based on a size of the particular image; executable code that selects a top score candidate; executable code that performs clean up processing for the top score candidate; and executable code that performs final page processing for the top score candidate.