12. A computer-implemented method for generating an entry in a forward index, the method being performed by one or more computing devices including at least one processor and one or more computer storage media, the method comprising: receiving a document and a corresponding document identification, wherein the document identification is configured to point to a starting location of the document in the forward index; receiving one or more static features associated with the document, wherein the one or more static features are supplementary features associated with document and are unrelated to a potential search query; parsing the document into tokens to form a token stream of the document; creating a compressed token stream based on the formed token stream, wherein the compressed token stream is a second token stream based on the token stream, the compressed token stream is a compressed version of the token stream comprising context streams of the document selected from the first token stream, wherein the one or more context streams represent individual sections of the document; upon creating the compressed token stream, calculating stream offsets for the context streams in the compressed token, wherein each stream offset provides a specific location of a context stream of the document; determining positional information from a position in the document of one or more relevant data, wherein the positional information is the relative location of an atom in the document generating the entry from the document identification, the token stream of the document, the compressed token stream, the stream offsets, the static features, and the positional information, wherein the document identification is a pointer to the starting location of the document that corresponds to at least the compressed token stream; and storing the entry in the forward index.
12. A computer-implemented method for generating an entry in a forward index, the method being performed by one or more computing devices including at least one processor and one or more computer storage media, the method comprising: receiving a document and a corresponding document identification, wherein the document identification is configured to point to a starting location of the document in the forward index; receiving one or more static features associated with the document, wherein the one or more static features are supplementary features associated with document and are unrelated to a potential search query; parsing the document into tokens to form a token stream of the document; creating a compressed token stream based on the formed token stream, wherein the compressed token stream is a second token stream based on the token stream, the compressed token stream is a compressed version of the token stream comprising context streams of the document selected from the first token stream, wherein the one or more context streams represent individual sections of the document; upon creating the compressed token stream, calculating stream offsets for the context streams in the compressed token, wherein each stream offset provides a specific location of a context stream of the document; determining positional information from a position in the document of one or more relevant data, wherein the positional information is the relative location of an atom in the document generating the entry from the document identification, the token stream of the document, the compressed token stream, the stream offsets, the static features, and the positional information, wherein the document identification is a pointer to the starting location of the document that corresponds to at least the compressed token stream; and storing the entry in the forward index. 14. The method of claim 12 , further comprising: receiving a search query; receiving an indication that the document associated with the generated entry in the forward index is relevant to the search query, wherein the relevancy is determined by using a reverse index that is indexed by atoms; creating a token map of the search query, the token map including query tokens; scanning the compressed token stream of the document to identify if any document tokens match any of the query tokens; and updating a data structure with a position in the token stream of any matches.