title: HTTPWebResponse + StreamReader Very Slow
body: <p>I'm trying to implement a limited web crawler in C# (for a few hundred sites only)
  using HttpWebResponse.GetResponse() and Streamreader.ReadToEnd() , also tried using StreamReader.Read() and a loop to build my HTML string.</p>
  
  <p><strong>I'm only downloading pages which are about 5-10K.</strong> </p>
  
  <p>It's all very slow! For example, the average GetResponse() time is about half a second, while the average StreamREader.ReadToEnd() time is about 5 seconds!</p>
  
  <p>All sites should be very fast, as they are very close to my location, and have fast servers. (in Explorer takes practically nothing to D/L) and I am not using any proxy.</p>
  
  <p>My Crawler has about 20 threads reading simultaneously from the same site. Could this be causing a problem?</p>
  
  <p>How do I reduce StreamReader.ReadToEnd times DRASTICALLY?</p>