# Crawl

Crawl pages witin a domain, reporting any page that returns a bad response code

Usage:

    > crawl [options] domain

    -s, --start /home,/about         Starting path(s), defaults to /
    -u, --username username          Basic auth username
    -p, --password password          Basic auth password
    -v, --verbose                    Give details when crawling
    -m, --markup                     Validate markup
    -h, --help                       Show this message

Example:

    > crawl http://alphasights.com --start=/no-such-page --verbose

      Adding /no-such-page
    Fetching /no-such-page ...

    Pages with errors:
    /no-such-page found on the command line - Status code: 404


# Crawl

Crawl pages within a domain, reporting any page that returns a bad response code

Usage:

    > crawl [options] domain

    Usage: crawl [options] domain
    -s, --start /home,/about         Starting path(s), defaults to /
    -u, --username username          Basic auth username
    -p, --password password          Basic auth password
    -c, --connections count          Max mumber of parallel connections to use. The default is 20.
    -v, --verbose                    Give details when crawling
    -h, --help                       Show this message
        --version                    Print version



Example:

    > crawl https://engineering.alphasights.com --connections=5 --start=/ --verbose

      Adding /
    Fetching / ...
      Adding /positions/ruby-developer
      Adding /positions/js-ember-developer
      Adding /positions/ux-ui-designer
      Adding /positions/support-specialist
    Fetching /positions/ruby-developer
    Fetching /positions/js-ember-developer ...
    Fetching /positions/ux-ui-designer ...
    Fetching /positions/support-specialist ...

    5 pages crawled without errors.


Update readme to reflect the --connections option
Update readme to reflect the --connections option

Also throw in a better example whilst we're at it
