1. A method for conducting an interaction with a user, the method comprising: collecting data about the user using at least one audio sensor positioned in a vicinity of the user; extracting feature data from the collected data using a plurality of feature extractors, wherein the feature data includes at least one feature of the collected data; combining the feature data from the plurality of feature extractors to produce combined features; modeling ones of the combined features as joint features; and classifying at least one of the joint features by at least one classifier using at least one model that defines an affective state of the user in accordance with the collected data; and tailoring an output to be delivered to the user in accordance with the affective state.