15. A computer readable storage device including instructions that, when executed by a processor, cause the processor to perform a method comprising: producing a lattice of object hypotheses based at least in part on a plurality of reference objects identified in an image corresponding to a geographic location, wherein each of the plurality of reference objects is related to a physical object at the geographic location; receiving input speech information that includes a request for information associated with at least a first reference object of the plurality of reference objects; producing a lattice of speech hypotheses based on at least a first possible description included in the speech information; producing a lattice of scored semantic hypotheses based on at least the lattice of object hypotheses and the lattice of speech hypotheses; determining that a single semantic interpretation score of the lattice of scored semantic hypotheses exceeds a predetermined value; and providing requested information associated with the at least the first reference object of the plurality of reference objects.
15. A computer readable storage device including instructions that, when executed by a processor, cause the processor to perform a method comprising: producing a lattice of object hypotheses based at least in part on a plurality of reference objects identified in an image corresponding to a geographic location, wherein each of the plurality of reference objects is related to a physical object at the geographic location; receiving input speech information that includes a request for information associated with at least a first reference object of the plurality of reference objects; producing a lattice of speech hypotheses based on at least a first possible description included in the speech information; producing a lattice of scored semantic hypotheses based on at least the lattice of object hypotheses and the lattice of speech hypotheses; determining that a single semantic interpretation score of the lattice of scored semantic hypotheses exceeds a predetermined value; and providing requested information associated with the at least the first reference object of the plurality of reference objects. 19. The computer readable storage device of claim 15 , wherein producing the lattice of scored semantic hypotheses based on at least the lattice of object hypotheses and the lattice of speech hypotheses includes producing the lattice of scored semantic hypotheses based on at least the lattice of object hypotheses, the lattice of speech hypotheses, and a finite state machine.