1. A method of updating with a search engine robot contents of a search engine database comprising a plurality of links, the method comprising: selecting a link from a link database; receiving a first search query from a user and displaying first search results of one or more links in response to a fist search query; determining with one or more computer processors, a popularity score for one or more of the links displayed in the first search results in response to the first search query wherein determining the popularity score of the link comprises: tracking when a user selects the link from the first search results; tracking when a user returns to the first search results and selects a different link; tracking the last link selected by the user from the first search results; tracking when the user revises the first search query to perform a revised search query for new links, wherein the revised search query indicates that the links in the first search results did not retrieve data the user is searching for; and wherein the one or more computer processors increases the popularity score of the last link selected by the user from the first search results when the user does not perform a revised search query; determining with one or more computer processors an age of the link; generating an update rank for the link based at least in part on the popularity score of the link and the age of the link; adding the link to a link queue based at least in part on the update rank of the link; accessing, in a content server with a first search engine robot, information associated with the link in the link queue; and updating, in the search engine database, the information obtained by the first search engine robot that is associated with the link in the link queue; accessing, in a content server with a second search engine robot, information associated with a link in the search engine database, wherein the link is selected based on the age of the link; and updating, in the search engine database, the information obtained by the second search engine robot that is associated with the link selected based on the age of the link.