1. A method for translating a video feed in real-time augmented reality from a first language to a second language using a mobile device comprising a video camera, a processor, a memory, and a display, the method comprising the steps of: (a) capturing a frame in real-time from the video feed of one or more words in the first language which need to be translated using the video camera to produce a captured frame; (b) cropping the captured frame to fit inside an image processing bounding box to produce a cropped frame; (c) pre-processing the cropped frame to produce a pre-processed frame; (d) performing character segment recognition on the pre-processed frame to produce a plurality of character segments; (e) performing character merging on the character segments to produce a plurality of merged character segments; (f) performing character recognition on the merged character segments to produce a recognized frame having a plurality of recognized characters; (g) processing the recognized frame through a translation engine to produce a translation of the recognized characters in the first language into one or more words of the second language to produce a translated frame, while also calculating a translation quality representing how well the recognized characters have been translated for each translated frame; (h) storing the translated frame to the memory as a current translated frame, wherein a previous translated frame and a previous translation quality is also stored in the memory; (i) checking that the bounding box has stayed on a same set of characters for the current translated frame and the previous translated frame by determining a fraction of similar characters that are overlapping between the current translated frame and the previous translated frame, wherein a higher fraction indicates that the bounding box has stayed on the same set of characters for the current translated frame and the previous translated frame; (j) comparing the translation quality determined by the translation engine for the current translated frame to the previous translation quality for the previous translated frame; (k) selecting one of the previous translated frame and the current translated frame to be removed from the memory based on a frame having a lower translation quality; and (l) displaying an optimal translated frame from the previous translated frame and the current translated frame, the optimal translated frame having a higher translation quality, wherein the words of the second language are overlaid over or next to the words in the first language which is being translated in an augmented reality on the display of the mobile device.
1. A method for translating a video feed in real-time augmented reality from a first language to a second language using a mobile device comprising a video camera, a processor, a memory, and a display, the method comprising the steps of: (a) capturing a frame in real-time from the video feed of one or more words in the first language which need to be translated using the video camera to produce a captured frame; (b) cropping the captured frame to fit inside an image processing bounding box to produce a cropped frame; (c) pre-processing the cropped frame to produce a pre-processed frame; (d) performing character segment recognition on the pre-processed frame to produce a plurality of character segments; (e) performing character merging on the character segments to produce a plurality of merged character segments; (f) performing character recognition on the merged character segments to produce a recognized frame having a plurality of recognized characters; (g) processing the recognized frame through a translation engine to produce a translation of the recognized characters in the first language into one or more words of the second language to produce a translated frame, while also calculating a translation quality representing how well the recognized characters have been translated for each translated frame; (h) storing the translated frame to the memory as a current translated frame, wherein a previous translated frame and a previous translation quality is also stored in the memory; (i) checking that the bounding box has stayed on a same set of characters for the current translated frame and the previous translated frame by determining a fraction of similar characters that are overlapping between the current translated frame and the previous translated frame, wherein a higher fraction indicates that the bounding box has stayed on the same set of characters for the current translated frame and the previous translated frame; (j) comparing the translation quality determined by the translation engine for the current translated frame to the previous translation quality for the previous translated frame; (k) selecting one of the previous translated frame and the current translated frame to be removed from the memory based on a frame having a lower translation quality; and (l) displaying an optimal translated frame from the previous translated frame and the current translated frame, the optimal translated frame having a higher translation quality, wherein the words of the second language are overlaid over or next to the words in the first language which is being translated in an augmented reality on the display of the mobile device. 12. The method of claim 1 , further comprising: storing a paused language translation frame comprising the first language and the second language in the memory for later review.