title: Capturing binary output from Process.StandardOutput
body: <p>In C# (.NET 4.0 running under Mono 2.8 on SuSE) I would like to run an external batch command and capture its ouput in binary form. The external tool I use is called 'samtools' (samtools.sourceforge.net) and among other things it can return records from an indexed binary file format called BAM. </p>
  
  <p>I use Process.Start to run the external command, and I know that I can capture its output by redirecting Process.StandardOutput. The problem is, that's a text stream with an encoding, so it doesn't give me access to the raw bytes of the output. The almost-working solution I found is to access the underlying stream.</p>
  
  <p>Here's my code:</p>
  
  <pre><code>        Process cmdProcess = new Process();
          ProcessStartInfo cmdStartInfo = new ProcessStartInfo();
          cmdStartInfo.FileName = "samtools";
  
          cmdStartInfo.RedirectStandardError = true;
          cmdStartInfo.RedirectStandardOutput = true;
          cmdStartInfo.RedirectStandardInput = false;
          cmdStartInfo.UseShellExecute = false;
          cmdStartInfo.CreateNoWindow = true;
  
          cmdStartInfo.Arguments = "view -u " + BamFileName + " " + chromosome + ":" + start + "-" + end;
  
          cmdProcess.EnableRaisingEvents = true;
          cmdProcess.StartInfo = cmdStartInfo;
          cmdProcess.Start();
  
          // Prepare to read each alignment (binary)
          var br = new BinaryReader(cmdProcess.StandardOutput.BaseStream);
  
          while (!cmdProcess.StandardOutput.EndOfStream)
          {
              // Consume the initial, undocumented BAM data 
              br.ReadBytes(23);
  </code></pre>
  
  <p>// ... more parsing follows</p>
  
  <p>But when I run this, the first 23bytes that I read are  not the first 23 bytes in the ouput, but rather somewhere several hundred or thousand bytes downstream. I assume that StreamReader does some buffering and so the underlying stream is already advanced say 4K into the output. The underlying stream does not support seeking back to the start.</p>
  
  <p>And I'm stuck here. Does anyone have a working solution for running an external command and capturing its stdout in binary form? The ouput may be very large so I would like to stream it.</p>
  
  <p>Any help appreciated. </p>
  
  <p>By the way, my current workaround is to have samtools return the records in text format, then parse those, but this is pretty slow and I'm hoping to speed things up by using the binary format directly.</p>