1. A speech translating apparatus comprising: a processor; a memory storing computer-executable instructions for execution by the processor; an input unit that inputs a speech in a first language; a speech recognizing unit that recognizes the speech and generates a first text; a translating unit that translates the first text into a second language and generates a second text; a first dividing unit that divides the first text into one or more first phrases; a second dividing unit that divides the second text into one or more second phrases; an associating unit that associates, as a phrase pair, a second phrase of the one or more second phrases with a first phrase from the one or more first phrases that is semantically equivalent to the second phrase; a storing unit that stores a plurality of associated phrase pairs as a phrase pair set; and an output unit that outputs, from the phrase pair set, the phrase pair of the second phrase and the first phrase associated with the second phrase in the phrase pair according to the order of appearance of the second phrase in the second text, such that the phrase pair is output in a phrase order of the second text; wherein the input unit inputs replacement speech while the output unit is outputting the phrase pair; and the output unit interrupts the output of the phrase pair when the input unit inputs the replacement speech, outputs the replacement speech, and following output of the replacement speech, resumes output of the remaining phrase pairs from the phrase pair set according to the phrase order of the second text.