title: Classifying websites
body: <p>I need to scrape a thousand websites that share the same structure: they all have a menu, a title, some text and a rating, much like a blog. Unfortunately, they are also coded very differently and some are manually, so I cannot reutilize CSS selectors, and perhaps not even rely upon them.</p>
  
  <p>I wonder how I can automatically classify them and save what is left of my hair. My first guess is to use lynx, or something text browser, to get some blocks of text and classify them according to their size.</p>
  
  <p>Do you know of a better or more sophisticate approach?</p>
  
  <p>Thank you!</p>