title: How do you speed up CSV file process? (5 million or more records)
body: <p>I wrote a VB.net console program to process CSV record that come in a text file. I'm using <a href="http://filehelpers.sourceforge.net/" rel="nofollow noreferrer">FileHelpers library</a></p>
  
  <p>along with MSFT Enterprise library 4. To read the record one at the time and insert into the database. </p>
  
  <p>It took about 3 - 4 hours to process 5+ million records on the text file.</p>
  
  <p>Is there anyway to speed up the process? Has anyone deal with such large amount of records before and how would you update such records if there is new data to be update?</p>
  
  <p>edit: Can someone recommend a profiler? prefer Open source or free.</p>