1. A method of generating a language model using non-speech meta-data, the method comprising: applying a tree growing algorithm to highly fragmented non-speech meta-data related to a caller to a spoken dialog system but does not describe physical characteristics of the caller; identifying a first quantity of leaf nodes in which a history appears as a result of applying the tree growing algorithm; identifying a second quantity of projections based on the highly fragmented non-speech meta-data, wherein the first quantity equals the second quantity; and estimating a conditional meta-data dependent language model using the identified projections and speech data.