1. A computer-readable medium having computer executable components for creating and maintaining a voice profile, comprising: a speech data collection component collecting a plurality of data packets containing digital representations of speech; a filter definitions component generating a filter definition based on information contained in the collected data packets; a speech analysis component analyzing the digital representations of speech contained in the data packets and generating a speech definition representative of the digital representations of speech; and a voice profile management component for generating a voice profile including the filter definition and the speech definition.