1. A computer-implemented method for generating an entry in a forward index, the method being performed by one or more computing devices including at least one processor and one or more computer storage media, the method comprising: receiving a document and a corresponding document identification; receiving one or more static features associated with the document, wherein the one or more static features are unrelated to a search query; parsing the document into tokens to form a token stream of the document; determining positional information from a position in the document of one or more relevant data, wherein the positional information is a relative location of an atom in the document identifying one or more context streams corresponding to the document, wherein the one or more context streams represent individual sections of the document; calculating stream offsets for the one or more context streams parsed from the document, wherein each stream offset provides a specific location of a context stream of the document; generating the entry from the document identification, the stream offsets, the token stream of the document, the static features, and the positional information, wherein the document identification is a pointer to the starting point of the document that corresponds to the token stream of the document, the stream offsets, the static features, and the positional information for the document; and storing the entry in the forward index.
1. A computer-implemented method for generating an entry in a forward index, the method being performed by one or more computing devices including at least one processor and one or more computer storage media, the method comprising: receiving a document and a corresponding document identification; receiving one or more static features associated with the document, wherein the one or more static features are unrelated to a search query; parsing the document into tokens to form a token stream of the document; determining positional information from a position in the document of one or more relevant data, wherein the positional information is a relative location of an atom in the document identifying one or more context streams corresponding to the document, wherein the one or more context streams represent individual sections of the document; calculating stream offsets for the one or more context streams parsed from the document, wherein each stream offset provides a specific location of a context stream of the document; generating the entry from the document identification, the stream offsets, the token stream of the document, the static features, and the positional information, wherein the document identification is a pointer to the starting point of the document that corresponds to the token stream of the document, the stream offsets, the static features, and the positional information for the document; and storing the entry in the forward index. 6. The method of claim 1 , further comprising: receiving a search query; receiving an indication that the document associated with the generated entry in the forward index is relevant to the search query, wherein the relevancy is determined by using a reverse index that is indexed by atoms; creating a token map of the search query, the token map including query tokens; scanning the token stream of the document to identify if any document tokens match any of the query tokens; and updating a data structure with a position in the token stream of any matches.