1. A speech translation system for simultaneously translating speech between first and second speakers, wherein the first speaker speaks in a first language and the second speaker speaks in a second language that is different from the first language, comprising: a first-language automatic speech recognition unit configured for accepting spoken sound from the first speaker in the first language to the second speaker and for continuously creating a plurality of partial hypotheses in the first language of the spoken sound of the first speaker in real time while the first speaker is speaking; a first-language resegmentation unit in communication with the first-language automatic speech recognition unit, wherein the first-language resegmentation unit is configured to: merge at least two partial hypotheses received from the first-language automatic speech recognition unit; and resegment the merged partial hypotheses into a first-language translatable segment in the first language, wherein a segment boundary for the first-language translatable segment is determined based on sound from the second speaker; and a first-language machine translation unit, in communication with the first-language resegmentation unit, that receives the first-language translatable segment in the first language from the first-language resegmentation unit, wherein the first-language machine translation unit outputs a translation of the spoken sound from the first speaker into the second language based on the received first-language translatable segment.