47. The system of claim 44 , wherein: each segment translation server is further operable to process translation of a segment before all of the requests in the request queue are served, and each segment translation server is further operable to finalize translation of the segment using the language model data obtained by the requests.
44. The system of claim 40 , wherein: each segment translation server comprises a segment translation server cache operable to store language model data obtained from the plurality of language model servers and the replica language model servers for translating a segment.