16. A system for speaker recognition, comprising: a repository storing a plurality of biometric signature libraries; a processor; and memory storing instructions when executed by the processor comprising functionalities for: obtaining speech data of a speaker to identify the speaker from a plurality of speakers; extracting a coarse feature of the speaker from the speech data; identifying the speaker as belonging to a pre-determined speaker cluster that is one of a plurality of partitions of the plurality of speakers and corresponds to a subset of a plurality of biometric signatures of the plurality of speakers, wherein identifying the speaker as belonging to the pre-determined speaker cluster is based on comparing the coarse feature of the speaker to a speaker independent parameter representing the subset of the plurality of biometric signatures; further identifying, in response to identifying the speaker as belonging to the pre-determined speaker cluster, the speaker as belonging to a second level pre-determined speaker cluster that is one of a plurality of second level partitions of the pre-determined speaker cluster and corresponds to a second level subset of the subset of the plurality of biometric signatures, wherein identifying the speaker as belonging to the second level pre-determined speaker cluster is based on comparing the coarse feature of the speaker to a second level speaker independent parameter representing the second level subset of the subset of the plurality of biometric signatures; extracting a plurality of Mel-Frequency Cepstral Coefficients (MFCC) for a Gaussian Mixture Model (GMM) from the speech data; determining a biometric signature of the speaker based on the plurality of MFCC and the GMM; and determining in real time, using the processor of the computer, an identity of the speaker by comparing the biometric signature of the speaker to the second level subset of the subset of the plurality of biometric signatures, wherein each of the plurality of biometric signatures is specific to one of the plurality of speakers.
19. The system of claim 16 , the instructions when executed by the processor further comprising functionality for: generating pre-processed speech data by removing silence frames and oversaturation frames from the speech data as well as normalizing loudness of the speech data, wherein the plurality of MFCC for the GMM are extracted from the pre-processed speech data.