8. A system comprising: one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising: receiving first speech data that corresponds to a first voice command input by a user; generating, by an automated speech recognizer, a transcription of the first speech data that corresponds to the first voice command input by the user; identifying, from the transcription of the first speech data that corresponds to the first voice command input by the user, (i) a candidate carrier phrase, and (ii) one or more terms that reference a particular subject; determining that a transcription of second speech data that corresponds to a second voice command subsequently input by the user includes the same one or more terms that reference the particular subject and does not include the candidate carrier phrase; in response to determining that the transcription of the second speech data that corresponds to the second voice command includes the same one or more terms that reference the particular subject and does not include the candidate carrier phrase, providing, for output, a search results page that includes (i) one or more results of an Internet search query in which the one or more terms that reference the particular subject are used as query terms, and (ii) an actuatable link for performing an action with respect to the particular subject; receiving a selection of the actuatable link for performing the action with respect to the particular subject; in response to receiving the selection of the actuatable link for performing the action with respect to the particular subject, adjusting a relevance score for the candidate carrier phrase and the action to indicate that the candidate carrier phrase has increased relevance to the action; and using, by an automated voice command processing engine, the relevance score to determine whether the action is to be performed upon subsequently identifying the candidate carrier phrase from a transcription of third speech data.
12. The system of claim 8 , wherein the operations comprise: in response to providing, for output, the search results page that includes (i) the one or more results of the Internet search query in which the one or more terms that reference the particular subject are used as query terms, and (ii) the actuatable link for performing the action with respect to the particular subject, receiving data indicating that the action is not the intended action to be performed with respect to the particular subject.