1. A method of analyzing documents or relationships between documents, comprising: receiving a notification of an available metadata document containing information about one or more network-accessible documents; obtaining a document format indicator associated with the metadata document; selecting a document crawler using the document format indicator; and crawling at least some of the network-accessible documents using the selected document crawler.