1. A method comprising the following computer-executable acts: causing a processor to access a deep-structured model retained in a computer-readable medium, wherein the deep-structured model comprises a plurality of layers with weights assigned thereto, transition probabilities between states, and language model scores; and jointly optimizing the weights, the transition probabilities, and the language model scores of the deep-structured model.