13. A non-transitory computer program product tangibly storing computer program instructions executable by a computer processor, the computer program instructions comprising instructions for: (A) automatically decoding, by a speech decoder executed by the computer processor, using Viterbi decoding for Large Vocabulary Conversational Speech Recognition (LVCSR), a first portion of an audio signal into a first word in a token stream; (B) after (A), (B-1) selecting, by the speech decoder, a punctuation mark without using acoustic evidence from the audio signal, and (B-2) inserting, by the speech decoder, the punctuation mark into the token stream at a position after the first word; and (C) after (B), decoding, by the speech decoder, a second portion of the audio signal into a second word in the token stream at a position after the punctuation mark; and (D) before (A), training a language model using a document corpus, wherein the document corpus includes words and punctuation; wherein the first portion and second portion of the audio signal are contiguous within the audio signal; wherein (A) comprises using the language model to decode the first portion of the audio signal into the first word; wherein (B) comprises using the language model to select the punctuation mark; and wherein (C) comprises using the language model to decode the second portion of the audio signal into the second word.
13. A non-transitory computer program product tangibly storing computer program instructions executable by a computer processor, the computer program instructions comprising instructions for: (A) automatically decoding, by a speech decoder executed by the computer processor, using Viterbi decoding for Large Vocabulary Conversational Speech Recognition (LVCSR), a first portion of an audio signal into a first word in a token stream; (B) after (A), (B-1) selecting, by the speech decoder, a punctuation mark without using acoustic evidence from the audio signal, and (B-2) inserting, by the speech decoder, the punctuation mark into the token stream at a position after the first word; and (C) after (B), decoding, by the speech decoder, a second portion of the audio signal into a second word in the token stream at a position after the punctuation mark; and (D) before (A), training a language model using a document corpus, wherein the document corpus includes words and punctuation; wherein the first portion and second portion of the audio signal are contiguous within the audio signal; wherein (A) comprises using the language model to decode the first portion of the audio signal into the first word; wherein (B) comprises using the language model to select the punctuation mark; and wherein (C) comprises using the language model to decode the second portion of the audio signal into the second word. 14. The computer program product of claim 13 , wherein the token stream comprises a document, wherein the first word comprises first text in the document, wherein the punctuation mark comprises second text in the document, and wherein the second word comprises third text in the document.