1. A computing device comprising: a processor; and memory that comprises instructions that, when executed by the processor, cause the processor to perform acts comprising: responsive to receiving a search query pertaining to an activity of interest in a scene, performing a search over a geospatial temporal (GST) graph for the activity in the scene, wherein the GST graph comprises: nodes that represent objects captured in a remote sensing image in the scene, wherein a first node in the nodes is assigned data indicating that the first node represents an object that is expected to change position over time; and undirected edges, wherein each undirected edge in the undirected edges couples a respective pair of nodes in the nodes, the undirected edge is assigned data that is indicative of a symmetric relationship between objects in the scene represented by nodes in the pair of nodes; identifying a location of the activity in the scene based upon the search of the GST graph; and outputting graphical data to a display indicating the location of activity in the scene.