1. A computer-implemented method for crawling application data from an application data store storing instances of business objects associated with an application, the method comprising: identifying, with a processor of a computer system, a first request for application data received from a search engine as a seed universal resource locator (URL) sourcing a business object associated with the application for crawling by the search engine; accessing, with the processor of the computer system, a crawlable definition for the business object associated with the application, the crawlable definition including information specifying a query selecting one or more attributes of the business object associated with the application; receiving, at the computer system, query results in response to sending the query to the application data store; forming, with the processor of the computer system, a crawlable document based on the query results, the crawlable document including information related to instances of the business object and corresponding to the one or more attributes of the business object from the query results; generating, with the processor of the computer system, a data feed based on the crawlable document; generating, with the processor of the computer system, a control feed based on dividing the data feed into a set of transferable batches according to predetermined criteria; generating, with the processor of the computer system, batch URLs for transferable batches in the set of transferable batches; returning a feed document to the search engine from the computer system, the feed document comprising the control feed and the batch URLs for the transferable batches in the set of transferable batches; identifying, with the of the computer system, a second request for application data received from the search engine as a re-entry URL associated with the feed document; returning, from the computer system, a batch from the data feed to the search engine where the batch is requested in the re-entry URL; returning, from the computer system, a related document to the search engine where the related document is requested in the re-entry URL; and returning, from the computer system, a dependent document to the search engine where the dependent document is requested in the re-entry URL.
5. The method of claim 1 , wherein dividing the data feed into the set of transferable batches according to predetermined criteria comprises dividing the data feed into the set of transferable batches based on a size capable of being transferred over a defined web enabled messaging protocol.