A team of scientists have developed a method of using machine learning to identify objects based on their description. AI was used to train the system and give a score based on how well audio captions were matched to an object in a given grid of cells. The researchers trained the algorithm by showing it images from Google Images, which are then compared with those that match up with known objects.
A team of scientists have developed a method of using machine learning to identify objects based on their description. AI was used to train the system and give a score based on how well audio captions were matched to an object in a given grid of cells. By having identical items described in different languages, the system could be used to expand speech recognition systems beyond the 100 or so tongues that currently have enough transcriptions.