21. The apparatus of claim 19 , further comprising a domain knowledgebase/ontology for capturing constraints, context, and common sense knowledge in an application domain.
19. An apparatus for converting a video to a text description, comprising: a receiver for receiving at least one frame of video; a segmenter module for partitioning said at least one frame of video into a plurality of blobs and for providing a semantic class label for each of said blobs; a tracking module for providing a global identifier for each of said blobs; a summarization module for constructing a graph from a plurality of semantic class labels representing said blobs at the vertices and a plurality of edges representing the spatial interactions between said blobs; and a description generation module for traversing the graph to generate text associated with the video.