title: hadoop getmerge to another machine
body: <p>Is it possible to store the output of the <code>hadoop dfs -getmerge</code> command to another machine?</p>
  
  <p>The reason is that there is no enough space in my local machine. The job output is 100GB and my local storage is 60GB. </p>
  
  <p>Another possible reason could be that I want to process the output in another program locally, in another machine and I don't want to transfer it twice (HDFS-> local FS -> remote machine). I just want (HDFS -> remote machine). </p>
  
  <p>I am looking for something similar to how <code>scp</code> works, like:</p>
  
  <p><code>hadoop dfs -getmerge /user/hduser/Job-output user@someIP:/home/user/</code></p>
  
  <p>Alternatively, I would also like to get the HDFS data from a remote host to my local machine.</p>
  
  <p>Could unix pipelines be used in this occasion?</p>
  
  <p>For those who are not familiar with hadoop, I am just looking for a way to replace a local dir parameter (<code>/user/hduser/Job-output</code>) in this command with a directory on a remote machine.</p>