1. A computer-implemented method for performing speech recognition, the method comprising: operating at least one processor programmed to perform: initiating a communication session with a speaker, the communication session requiring automatic speech recognition (ASR); determining a characteristic of the speaker, the characteristic selected from a group consisting of a speaker identity and at least one voice characteristic for the speaker; identifying a speaker-dependent, phrase-based grammar to use in the communication session with the speaker, wherein different speaker-dependent, phrase-based grammars are used for different users based on at least one speaker-dependent feature independent of a gender of the users; recording feedback of ASR phrase processing operations during the communication session, wherein each ASR phrase processing operation seeks to match a spoken utterance against at least one entry within the identified speaker-dependent, phrase-based grammar, each entry of the at least one entry within said identified speaker-dependent, phrase-based grammar having a plurality of grammar option weights, each of the plurality of grammar option weights corresponding to a respective speech processing context, wherein the grammar option weights affect which entries are matched to the spoken utterances; automatically adjusting the grammar option weights based upon recorded feedback data for the communication session to improve accuracy of the identified speaker-dependent, phrase-based grammar.