# ldspider scripts

LDSpider is a system to crawl the URLs exposing RDF recursively. This repository
presents the script to start using LDSpider on a single URI and perform
breadth-first crawl (we are interested in crawling as much data as possible, not
get the complete info about the subject).

## Getting started

Fetch https://www.wikidata.org/wiki/Q12737077 and 1 level resources it links to:

    cd bin/
    ./crawl.sh https://www.wikidata.org/wiki/Q12737077 1
    less crawl-*

Requires Maven 3.

# ldspider scripts

LDSpider is a system to crawl the URLs exposing RDF recursively. This repository
presents the script to start using LDSpider on a single URI and perform
breadth-first crawl (we are interested in crawling as much data as possible, not
get the complete info about the subject).

## Getting started

Clone this repository recursively:

    git clone --recursive https://github.com/berezovskyi/ldspider-runner

Fetch https://www.wikidata.org/wiki/Q12737077 and 1 level resources it links to:

    cd bin/
    ./crawl.sh https://www.wikidata.org/wiki/Q12737077 1
    less crawl-*

Requires Maven 3.

Add instructions to clone recursively
Add instructions to clone recursively
