I want to scan a website content, recursively, and pipe it to another program.When I run:wget -r -O - $SITEI getWARNING: combining -O with -r or -p will mean that all downloaded contentwill be placed in the single file you specified.Then, download process starts, but hangs after the first page is done. By hangs I mean, nothing seems to be going on, nor do I get back the command prompt until I hit Ctrl+C.I would prefer avoiding the option outputting wget to a temporary folder and scan file by file, as well as writing my own scrapper which seems to be the most redundant act one can think of at the end of 2012.
routing wget --recursive to stdout (as in -O -) rather than a file
wget;recursive;stdout