title: Can I use spark to parse html file?
body: <p>I am facing a problem:</p>
  
  <p>I want to parse a bunch of html files in <strong>HDFS</strong>, and I want to use <strong>spark</strong> to process them. For convenient, I want to use <strong>pyspark</strong>, and also want to use the powerful package <strong>BeautifulSoup</strong> to parse the html files. Is it possible for me to do that? And how can read the files from HDFS by using BeautifulSoup?  </p>