5. The apparatus of claim 1 , further comprising an omission rule learner ( 112 ) configured to automatically create, delete, or modify omission rules.
5. The apparatus of claim 1 , further comprising an omission rule learner ( 112 ) configured to automatically create, delete, or modify omission rules. 6. The apparatus of claim 5 , wherein the omission rule learner is configured to collect statistics about how frequently a particular link type is followed through an index and create an omission rule that causes links of that type not to be added to the index.