3. The method of claim 2 , wherein determining the plurality of active non-textual data elements displayed in an active window of an application environment of the application comprises determining one or more images displayed in the application environment and selected in the application environment.
3. The method of claim 2 , wherein determining the plurality of active non-textual data elements displayed in an active window of an application environment of the application comprises determining one or more images displayed in the application environment and selected in the application environment. 6. The method of claim 3 , wherein determining, from the plurality of active non-textual data elements, modification data for the query comprises: determining, from the one or more selected images, entity text describing entities depicted in the one or more images; and for each entity, generating a modified query based on the query and the entity.