10. The method of claim 9 , wherein determining, from the plurality of active non-textual data elements, modification data for the query comprises: processing a video frame for structured video data; detecting structured video data; deriving text from the structured video data; and generating a modified query based on the query and the text.
10. The method of claim 9 , wherein determining, from the plurality of active non-textual data elements, modification data for the query comprises: processing a video frame for structured video data; detecting structured video data; deriving text from the structured video data; and generating a modified query based on the query and the text. 12. The method of claim 10 , wherein deriving text from the structured video data comprises detecting entity text that describes an entity.