44. The system of claim 40 , wherein: each segment translation server comprises a segment translation server cache operable to store language model data obtained from the plurality of language model servers and the replica language model servers for translating a segment.
44. The system of claim 40 , wherein: each segment translation server comprises a segment translation server cache operable to store language model data obtained from the plurality of language model servers and the replica language model servers for translating a segment. 46. The system of claim 44 , wherein: each segment translation server further comprises a request queue which is operable to store requests for language model data to be obtained from the plurality of language model servers, and each segment translation server is operable to sequentially send the requests in the request queue to one or more of the plurality of language model servers and the replica language model servers and store language model data obtained by the requests in the segment translation server cache.