1. A system comprises: a server system comprising: one or more processor devices; memory in communication with the one or more processor devices; and a storage device that stores a program of computing instructions for execution by the processor using the memory, the program comprising instructions configured to cause the processor to: receive images from a mixed reality device, which images including representations of physical objects; receive voice data from the mixed reality device; execute a cognitive agent to process the voice data received from the mixed reality device with the cognitive agent including: a natural language process pre-processor that parses text input into tagged words and phrases to provide a first data structure that represents the text input with words and phrases connected to each other and annotated with indicators of meaning; a response macro-planner that determines information content of a response from the representation of the text input to produce a second data structure that contains the response in a form that contains concepts and concept qualifiers that comprise logic behind the response; and a micro-planner that produces sentences from the second data structure for the response from the cognitive agent; determine location information to determine a correspondence between the representations of the physical objects in the images and stored information concerning the set of physical objects; generate a set of virtual objects that include data describing merchandising process concepts regarding the set of physical objects, based on input queries received in the voice data; and send the set of virtual objects to the mixed reality device.