13. The system of claim 7 , wherein the content of the webpage comprises one or more of an anchor, a header, and a page title of a web page.
7. A system for training a web crawler, wherein the web crawler maintains one or more categories each comprising a set of words, the system comprises: one or more processors operable to execute one or more instructions to: select at least one hyperlink in response to a query received from a user based on the set of words; determine a hyperlink score for the at least one hyperlink based on a predetermined category score associated with each of one or more categories and a membership value of the at least one hyperlink for each of the one or more categories; update the predetermined category score associated with each of the one or more categories based at least on a discount factor associated with the predetermined category score and an association of learning rate with a measure of contribution of the one or more categories for the selection of the at least one hyperlink and another measure of correctness of the selection of the at least one hyperlink with respect to semantic of the query; compare the updated predetermined category score with the hyperlink score to select a category from the one or more categories; and update the set of words associated with the category based on content of a webpage pointed by the at least one hyperlink.