title: How to index html, css, and javascript using solr
body: <p>Users of <a href="http://codepen.io" rel="nofollow">CodePen</a> submit html/css/javascript each time they save a pen.  We're setting up Solr search and I'd like to know if any work has been done to properly tokenize html/css/js for optimal retrieval.</p>
  
  <p>For example in javascript, we'd like code like</p>
  
  <p><code>
  window.location = 'http://wufoo.com'
  </code></p>
  
  <p>to produce a search hit on <code>window</code>, <code>location</code> and <code>window.location</code>.</p>
  
  <p>Also, for html, we don't wish to strip out brackets on elements like <code>&lt;form&gt;</code> or <code>&lt;field&gt;</code>.</p>
  
  <p>Before I go down the road of writing a custom field type, I'd like to know if anyone has already tackled this problem.  Since we index each field individually, we'll need a separate tokenizer with rules specific for css, html, and javascript.</p>