title: Flume not writing to HDFS unless killed
body: <p>I followed the <a href="http://blog.cloudera.com/blog/2012/10/analyzing-twitter-data-with-hadoop-part-2-gathering-data-with-flume/" rel="noreferrer">link</a> for setting TwitterSource and HDFS sink.</p>
  
  <p>Command used for starting the agent: </p>
  
  <pre><code>bin/flume-ng agent -n TwitterAgent -c conf -f conf/flume-conf.properties -Dflume.root.logger=DEBUG,console
  </code></pre>
  
  <p>I was successful in doing that, but there is one problem now.
  The output doesn't get written until stop the flume agent. It gets written to the HDFS once i kill my flume agent.</p>
  
  <p>I have two questions here:</p>
  
  <p>1) How to stop a flume agent - Is there any way other than doing CTRL+C.</p>
  
  <p>2) Can I make the flume-agent write to the HDFS on the go, without having to kill the agent.</p>
  
  <p>Note : After killing the process, the file that is written has .tmp as extension. Is it expected?</p>
  
  <p><strong>EDIT:</strong></p>
  
  <pre><code>TwitterAgent.sinks.HDFS.hdfs.rollSize = 0
  TwitterAgent.sinks.HDFS.hdfs.rollCount = 10000
  TwitterAgent.sinks.HDFS.hdfs.rollInterval = 600
  </code></pre>