1. A program storage device readable by computer-processor, tangibly embodying a program of instructions executable by the computer-processor to perform method steps for creating a disfluency translation lattice, the method steps comprising: providing a plurality of weighted finite state transducers including a translation model, a language model, and a phrase segmentation model as input; performing a cascaded composition of the weighted finite state transducers to create a disfluency translation lattice; storing the disfluency translation lattice to a computer-readable media coupled to the computer-processor; and coupling the disfluency translation lattice to a decoder for receiving noisy speech and outputting clean speech corresponding to the noisy speech, wherein the clean speech is output comprising disfluent class label tokens replacing disfluent speech, and wherein the tokens include tags identifying different types of disfluency.