title: boost tokenizer / char separator
body: <p>I have tried with both commented and uncomented version of the code:</p>
  
  <pre><code>string separator1(""); //dont let quoted arguments escape themselves
  string separator2(",\n"); //split on comma and newline
  string separator3("\"\'"); //let it have quoted arguments
  
  escaped_list_separator&lt;char&gt; els(separator1, separator2, separator4);
  tokenizer&lt;escaped_list_separator&lt;char&gt;&gt; tok(str);//, els);
  
  
  for (tokenizer&lt;escaped_list_separator&lt;char&gt;&gt;::iterator beg = tok.begin();beg!= tok.end(); ++beg) {
  next = *beg;
  boost::trim(next);
  cout &lt;&lt; counter &lt;&lt; " " &lt;&lt; next &lt;&lt; endl;
  counter++;
  }
  </code></pre>
  
  <p>to separate a file which has the following format:</p>
  
  <pre><code> 12345, Test Test, Test
   98765, Test2 test2, Test2
  </code></pre>
  
  <p>This is the output</p>
  
  <pre><code>0 12345
  1 Test Test
  2 Test
  98765
  3 Test2 test2
  4 Test2
  </code></pre>
  
  <p>I am not sure where the problem is but what I need to achieve is to have a number 3 before 98765 </p>