title: C++ - Remove or skip quote char in reading a file line by tokenizer
body: <p>I have a csv file that has records like:</p>
  
  <blockquote>
    <p>837478739*"EP"<em>1</em>"3FB2B464BD5003B55CA6065E8E040A2A"*"F"*21*15*"NH"*"N"<em>0</em>*-1*"-1"*0*0**-1*223944*-1*"23"<em>1</em>"-1"<em>"-1"</em>"78909"<em>"-1"</em>"-1"<em>"-1"</em>"-1"<em>"-1"</em>"-1"<em>"-1"</em>"-1"<em>"-1"</em>"-1"<em>"-1"</em>"-1"<em>"-1"</em>"74425"<em>"26"</em>"-1"*"-1"*1*1*69*23.58*0*0*0*0*"MC"</p>
  </blockquote>
  
  <p>The file has lots of records, so I need a fast method to breakdown the line and push_back each of those parts into a vector. The main reason I choose tokenizer is that I heard a lot about its performance. I have a function:</p>
  
  <pre><code>void break(){
     //using namespace boost;
     string s = "This is a , test '' file";
     boost::tokenizer&lt;&gt; tok(s);
     vector&lt;string&gt; line;
     for(boost::tokenizer&lt;&gt;::iterator beg=tok.begin();beg!=tok.end();++beg){
         line.push_back(*beg);
     }
     cout &lt;&lt; line[3] &lt;&lt; "  and  " &lt;&lt; line[5] &lt;&lt; endl;
  }
  </code></pre>
  
  <p>By that I can get each part of the sentence and ignore everything that is not a letter. Does the tokenizer have the ability to read the record that I have and parse them by "*" delimiter and remove the quotes from the string? There won't be any kind of special character between quotes, I just need to remove the quote marks. I tried to read the tokenizer document, but nothing came out.</p>