Audio Analysis : Segment audio based on speaker recognition I have audio clips of people being interviewed and am trying to split the audio clips using python such that all speech segments of the interviewee are outputted in one audio file (eg .wav format) &amp; that of the interviewer in another audio file. Speaker recognition needs to be performed using unsupervised learning.

So far I have found a few libraries that perform the speaker diarization task (pyAudioAnalysis, aalto-speech) but none that combine the different speaker segments and output it in separate audio files. How do I segment the audio files &amp; combine them based on the speaker?
Initially I did using silence detection but later moved to pyAudioAnalsis which is better.   

Check "Speaker Diarization" section in Segmentation in pyAudioAnalysis