5. A voice processing apparatus as set forth in claim 3 , wherein said data processing means compares said first speaker data with said second speaker data and, only when the two are not matched, processes the voice signal output from said one microphone by associating with said first speaker data.
9. A voice processing apparatus as set forth in claim 5 , further comprising a voice conversion means for converting a voice signal to character string data, wherein said voice conversion means converts the voice signal collected by said one microphone to character string data; and said data processing means processes said character string data by associating with the speaker data obtained by checking against said voice signal.