1. A computer implemented method for multimodal cross-vocabulary mapping, the computer implemented method comprising: annotating a corpus of multimodal content simultaneously using annotations from a plurality of vocabularies to form a set of common annotations; identifying relationships between a first vocabulary associated with a first modality and a second vocabulary associated with a second modality using the set of common annotations to form a multimodal vocabulary mapping; and mapping items in the first vocabulary associated with the first modality to items in the second vocabulary associated with the second modality using the multimodal vocabulary mapping.