title: creating log files for DB table entries using SSIS package
body: <p>I have an application that after doing parsing inserts records into a table. There are +- 30 million records a day and I usually send a report for daily totals at the end of the day. Now I am required to create log files every few minutes or seconds so that we can feed the counts of new records inserted into a realtime syslog type feed application that will display this data realtime. I am not sure if I should write to a text file each time I do an insert or should I create these log files from within sql server for that table. Can this even be done? I am worried about the overhead in writing to a file after each insert. Any advice appreciated.</p>
  
  <p>EDIT:</p>
  
  <p>I wanted to word the question a little differently. I already use a SSIS sql package to create log files once a day. Can I setup the queries to run every 30 minutes or so and collect all new records inserted since the last run?</p>
  
  <p>I have 3/4 columns in the table one of which is used in the select, which is the dateAdded column and the records are grouped according to this column for daily reports.</p>