15. A non-transitory computer-readable storage device encoded with instructions that, when executed by a data processing apparatus, cause the data processing apparatus to perform operations comprising: receiving spoken input from a user of an electronic device in an application among a plurality of applications that are capable of being executed on the electronic device; determining a category for the application; providing the spoken input and data that indicates the application category to a server that includes a speech recognition system configured to select one or more language models to generate text based on the spoken input, wherein the one or more language models are selected based on the data that indicates the application category; receiving text from the server, wherein the text represents a transcription of the spoken input; and providing the text as input to the application.
20. The non-transitory computer-readable storage device of claim 15 , wherein the operations further comprise: generating a correlation between the spoken input and the application category, comprising matching one or more utterances in the spoken input to one or more stored items that are associated with the application category, wherein the one or more language models are further selected based on the correlation.