1. A method of language modeling of a document comprising: computing, by a computer processor, a plurality of local probabilities of a current document; determining a vector representation of the current document in a latent semantic analysis (LSA) space at a first time based on a first number of words present in the current document from a second time to the first time, wherein the second time precedes the first time; computing, by a computer processor, a plurality of global probabilities based upon the vector representation of the current document in an LSA space; and combining the local probabilities and the global probabilities to produce a language modeling.