title: how to remove duplicated tokens in solr
body: <p>Followup question to <a href="https://stackoverflow.com/questions/10329470/why-solr-removeduplicatestokenfilterfactory-dont-work">Why solr RemoveDuplicatesTokenFilterFactory dont work?</a></p>
  
  <p>How I can make solr remove duplicated words regardless of word position?</p>
  
  <p>For example:</p>
  
  <pre><code>Field value:                    text word word text word word
  Expected tokens after X filter: text word
  </code></pre>