15. The method of claim 12 , wherein the crawling rules define page-specific rules for at least two distinct pages.
15. The method of claim 12 , wherein the crawling rules define page-specific rules for at least two distinct pages. 16. The method of claim 15 , wherein the crawling rules define element-specific rules for at least two distinct elements.