Audio files similarity check I have big database of audio files, about 1-2 s long. Different people say different words, but during process I done some duplicates which I have to find and remove (database is about 100000 sounds and it is difficult to listen, have some noise, or are similar to human, but are different). Some duplicate audio files cant be shifted by half a second or less during cutting process.  

Please help.
How can I find real duplicates in my audio database?
Here are three methods of finding duplicates in a database of audio files. If I've understood your question correctly, I think you want the cross-correlation approach. 

Looking for identical files - md5 checksum (not a DSP solution I know)

Looking for identical audio samples but time-shifted - cross correlation

Looking for similar sounding audio but different samples - audio fingerprinting.