12. A system for crawling, comprising: at least one CPU processor configured to: retrieve a first electronic document from a location that includes a specific file name, wherein a web crawler is preconfigured to find information relating to searching at the specific file name; determine that an explicit enumeration of at least one document containing local content exists, wherein the enumeration of the at least one document containing local content is associated with the first document; detect a tag associated with the enumeration of the at least one document containing local content, wherein the tag specifies that a second document at a specified location is indexable, wherein the second document is one of the at least one document containing local content; retrieve the second document from the specified location; and index the second document for searching; and at least one memory coupled with the at least one CPU processor, wherein the at least one memory provides instructions to the at least one CPU processor.
12. A system for crawling, comprising: at least one CPU processor configured to: retrieve a first electronic document from a location that includes a specific file name, wherein a web crawler is preconfigured to find information relating to searching at the specific file name; determine that an explicit enumeration of at least one document containing local content exists, wherein the enumeration of the at least one document containing local content is associated with the first document; detect a tag associated with the enumeration of the at least one document containing local content, wherein the tag specifies that a second document at a specified location is indexable, wherein the second document is one of the at least one document containing local content; retrieve the second document from the specified location; and index the second document for searching; and at least one memory coupled with the at least one CPU processor, wherein the at least one memory provides instructions to the at least one CPU processor. 14. The system of claim 12 , wherein the processor is further configured to determine that a closing tag exists.