title: wget or curl from stdin
body: <p>I'd like to download a web pages while supplying URLs from stdin. Essentially one process continuously produces URLs to stdout/file and I want to pipe them to wget or curl. (Think about it as simple web crawler if you want).</p>
  
  <p>This seems to work fine:</p>
  
  <pre><code>tail 1.log | wget -i - -O - -q 
  </code></pre>
  
  <p>But when I use 'tail -f' and it doesn't work anymore (buffering or wget is waiting for EOF?):</p>
  
  <pre><code>tail -f 1.log | wget -i - -O - -q
  </code></pre>
  
  <p>Could anybody provide a solution using wget, curl or any other standard Unix tool? Ideally I don't won't want to restart wget in the loop, just keep it running downloading URLs as they come.</p>