1. A computer-implemented method of processing a visual query comprising: at a server system having one or more processors and memory storing one or more programs for execution by the one or more processors: receiving a visual query from a client system; receiving location information from the client system; sending the visual query and the location information to a visual query search system; receiving one or more search results in accordance with both the visual query and the location information from the visual query search system; identifying, from the one or more search results, an entity in the visual query; identifying one or more client-side actions corresponding to the identified entity; creating an actionable search result element configured to launch a respective client-side action of the identified one or more client-side actions; and sending the actionable search result element to the client system.