title: Best way to stream PDF Files
body: <p>What would be a good way to stream PDF files through a messaging queue?</p>
  
  <p>Would it be a good idea to do this in KAFKA?</p>
  
  <p>Here is what i have in mind:</p>
  
  <ol>
  <li>Pick up the PDF files from a file drop location.</li>
  <li>Stream the files through Kafka.</li>
  <li>Parse the files for some low level Info Retrieval and cleanup. This will probably be done in a Storm topology or Spark. Maybe some custom Map Reduce code.</li>
  <li>Finally, i wan to run some machine learning algorithms on these documents.</li>
  </ol>
  
  <p>Note that the steps mentioned above are just possibilities. If you have a better implementation, please suggest. </p>