2. The method of claim 1 , further comprising: determining that two or more semantic interpretation scores of the lattice of scored semantic hypotheses exceeds the predetermined value; receiving clarification from a user; and providing requested information associated with at least a second reference object of the plurality of reference objects.
1. A method comprising: producing a lattice of object hypotheses based at least in part on a plurality of reference objects identified in an image corresponding to a geographic location, wherein each of the plurality of reference objects is related to a physical object at the geographic location; receiving input speech information that includes a request for information associated with at least a first reference object of the plurality of reference objects; producing a lattice of speech hypotheses based on at least a first possible description included in the speech information; producing a lattice of scored semantic hypotheses based on at least the lattice of object hypotheses and the lattice of speech hypotheses; determining that a single semantic interpretation score of the lattice of scored semantic hypotheses exceeds a predetermined value; and providing requested information associated with the at least the first reference object of the plurality of reference objects.