1. A device comprising: a processor; and a computer-readable medium in communication with the processor, the computer-readable medium including modules comprising: a caption generator module configured to receive a query, the query comprising an image, a detector module configured to detect a set of words with a determined probability to be associated with the query, a sentence generator module configured to generate a set of sentences from the set of words, a sentence re-ranker module configured to rank the set of sentences to generate caption sentences by using a deep multimodal similarity model module, the deep multimodal similarity model module configured to use an image model to generate an image vector from the query and a text model to generate a plurality of text vectors from the set of sentences, and the deep multimodal similarity module further configured to associate the most relevant sentence of the caption sentences as a caption for the image.