title: Losing data between fluentd and influxdb
body: <p>I'm struggling with data loss between fluentd and influxdb. </p>
  
  <p>Using the fluent-plugin-influxdb plugin with this configuration:</p>
  
  <pre><code>&lt;source&gt;
    id test_syslog
    type syslog
    port 42185
    protocol_type tcp
    time_format %Y-%m-%dT%H:%M:%SZ
    tag test_syslog
    format /^(?&lt;time&gt;[^ ]*) (?&lt;fastly_server&gt;[^ ]*) (?&lt;log_name&gt;[^ ]*) (?&lt;host&gt;[^ ]*) ([^ ]*) ([^ ]*) (?&lt;http_method&gt;[^ ]*) (?&lt;http_request&gt;[^ ]*) (?&lt;http_status&gt;[^ ]*) (?&lt;cache_status&gt;[^ ]*) (?&lt;uuid&gt;[^ ]*) *(?&lt;device_model&gt;.*)$/
  &lt;/source&gt;
  
  &lt;match test_syslog.**&gt;
    type copy
    &lt;store&gt;
      type file
      path /var/log/td-agent/test_syslog
    &lt;/store&gt;
    &lt;store&gt;
      id test_syslog
      type influxdb
      dbname test1
      flush_interval 10s
      host localhost
      port 8086
      remove_tag_suffix .local0.info
    &lt;/store&gt;
  &lt;/match&gt;
  </code></pre>
  
  <p>When comparing the file output and the data in influxdb I find this:</p>
  
  <pre><code>user@ip-xxx-xxx-xxx-xxx:/var/log/td-agent# curl -G 'http://localhost:8086/query' --data-urlencode "db=test1" --data-urlencode "q=SELECT COUNT(host) FROM log_data" ; cat test_syslog.20150901.b51eb4653c54c63e7 | wc -l
  {"results":[{"series":[{"name":"log_data","columns":["time","count"],"values":[["1970-01-01T00:00:00Z",582]]}]}]}2355
  </code></pre>
  
  <p>2355 lines in the log, but only 582 records in the database.</p>
  
  <p>I've enabled debug/trace logging from both influxdb and fluentd but nothing interesting in the logs so far.</p>
  
  <p>Any ideas?</p>