Background human voices
- On September 28, 2023
- human noise
There are many cases in which the background noise in phone calls includes human voices. This might happen, for example, in the office where there are other people talking in the background. An extreme case is a crowded call center environment but human noise is not limited to the office and can also appear in other locations like at home or in a coffee shop where there are other people talking in the background. In this post we will try to discuss if and how can a noise reduction application keep the voice of the primary speaker while removing the voices of all other people in the background.
Let’s look at the simple case of one microphone and no a prior knowledge about the primary speaker. In this case, the noise reduction will sometime hear the primary speaker and sometimes hear other people in the background and sometime all voices will be mixed. How can the noise reduction application decide which voice belongs to the primary speaker and which voice belongs to the people in the background? These are all human voices.
Can we rely on volume? Unfortunately volume is not a good indicator since it might miss in both directions – i.e. false positive and false negative. it might indicate that a loud background voice belong to the primary speaker and vice versa it might indicate that a quiet vowels of the primary speaker are background voices. As a result relying on volume to identify the human voices is not a robust method for a production application.
Can we rely on some distance indication? Unfortunately, most common microphones are designed to capture all sounds regardless their distance or direction. Therefore the distance does not play a significant factor with regards to how the voices are captured by the microphone.
Can we learn the voice of the primary speaker during the call? In this approach we learn different features of the voice of the primary speaker during the call and we can use these features to eliminate any voice that does not comply with them. This could have been an excellent approach but unfortunately it falls under the category of “Which came first, the chicken or the egg?”. In other words, the noise reduction application might wrongly learn the features of voices in the background. For example, if the primary speaker stops talking for few seconds and only the background voice is heard, the noise reduction software might learn on the fly the features of the background voice and when the primary speaker starts talking again, his/her voice will be treated as noise since it does not comply with the features of the background voice.
OK, so what can we do to enable a software noise reduction application to effectively remove ambient human voices? There are two approaches to achieve this goal. The first approach is to use more than a single microphone in order to identify the physical location of each voice. This technique is used by mobile phones, which as you know are equipped with multiple microphones, and is also available in our Noise Firewall products. In office environment we use the multiple phones that already exists in the office to build a noise map and identify the physical location of each human voice. For stand-alone environment, use SoliCall Pro with additional USB microphone to effectively cancel ambient human voices. This type of noise removal is called Reference Based Noise Reduction (a.k.a. RNR)
A different approach would be to provide the software with a prior information about the voice of the primary speaker. Basically you would need to train the software on the voice of the primary speaker prior to asking it to clean noisy calls. This type of noise removal is called Profile Based Noise Reduction (a.k.a. PNR).
Sauti za nyuma za binadamu - Septemba 28, 2023 - Sauti ya binadamu Kuna kesi nyingi ambazo kelele za nyuma katika simu zinajumuisha sauti za binadamu. Hii inaweza kutokea, kwa mfano, katika ofisi ambapo kuna watu wengine kuzungumza katika background. Kwa mfano, katika kituo cha simu, kelele ya mtu inaweza kuonekana katika maeneo mengine kama vile nyumbani au katika duka la kahawa ambapo kuna watu wengine wanaozungumza nyuma. Katika chapisho hili tutajaribu kujadili ikiwa na jinsi programu ya kupunguza kelele inaweza kuweka sauti ya msemaji wa msingi wakati wa kuondoa sauti za watu wengine wote nyuma. Hebu kuangalia kesi rahisi ya kipaza sauti moja na hakuna maarifa ya awali kuhusu msemaji wa msingi. Katika kesi hii, kupunguza kelele wakati mwingine kusikia msemaji kuu na wakati mwingine kusikia watu wengine katika background na wakati mwingine sauti zote itakuwa mchanganyiko. Jinsi gani programu ya kupunguza kelele inaweza kuamua ambayo sauti ni mali ya msemaji wa msingi na ambayo sauti ni mali ya watu katika background? Hizi zote ni sauti za kibinadamu. Je, tunaweza kutegemea kiasi cha sauti? Kwa bahati mbaya kiasi si kiashiria nzuri tangu inaweza kukosa katika pande zote mbili <unk> i.e. Uhakika wa uongo na hasi ya uongo "Hiyo inaweza kuonyesha kwamba sauti kubwa ya nyuma ni ya msemaji wa msingi na kinyume chake inaweza kuonyesha kwamba vokali za chini za msemaji wa msingi ni sauti za nyuma. """ Kama matokeo kutegemea kiasi cha kutambua sauti za binadamu si mbinu imara kwa ajili ya maombi ya uzalishaji. Je, twaweza kutegemea ishara fulani ya umbali? Kwa kusikitisha, maikrofoni ya kawaida hutumiwa kukusanya sauti zote bila kujali umbali au mwelekeo. Kwa hiyo umbali si kucheza sababu muhimu kuhusiana na jinsi sauti ni kukamatwa na kipaza sauti. Je, tunaweza kujifunza sauti ya msemaji mkuu wakati wa simu? Katika mbinu hii, tunajifunza sifa tofauti za sauti ya msemaji wa msingi wakati wa wito na tunaweza kutumia sifa hizi kuondoa sauti yoyote ambayo haifai. Hii ingeweza kuwa mbinu bora lakini kwa bahati mbaya inashuka chini ya jamii ya <unk>Ni nini kilichokuja kwanza, kuku au yai?<unk>. Kwa maneno mengine, programu ya kupunguza kelele inaweza kujifunza kimakosa sifa za sauti za nyuma. Kwa mfano, ikiwa msemaji wa msingi anasimama kwa sekunde chache na sauti ya nyuma tu inasikika, programu ya kupunguza kelele inaweza kujifunza juu ya kuruka, na wakati msemaji wa msingi anaanza kuzungumza tena, sauti yake itatibiwa kama kelele kwa sababu haifai na sifa za sauti ya nyuma. Kwa hivyo, ni nini kinachohitajika ili programu ya kupunguza kelele iweze kuondoa sauti za binadamu? Kuna njia mbili za kufikia mradi huo. Njia ya kwanza ni kutumia zaidi ya kipaza sauti kimoja ili kutambua mahali pa kila sauti. Hii ni mbinu ya simu za mkononi, ambayo kama unavyojua ni vifaa na maikrofoni nyingi, na pia inapatikana katika bidhaa zetu Noise Firewall. Katika mazingira ya ofisi, tunatumia simu nyingi zilizopo tayari katika ofisi kujenga ramani ya kelele na kutambua eneo la kimwili la kila sauti ya binadamu. Kwa mazingira ya kujitegemea, tumia SoliCall Pro na kipaza sauti cha ziada cha USB kufuta kwa ufanisi sauti za binadamu za mazingira. Aina hii ya kuondoa kelele inaitwa Reference Based Noise Reduction (a.k.a. RNR: Njia tofauti ingekuwa kutoa programu na taarifa ya awali kuhusu sauti ya msemaji wa msingi. Kimsingi unahitaji mafunzo ya programu juu ya sauti ya msemaji wa msingi kabla ya kuuliza kusafisha wito kelele. Aina hii ya kuondoa kelele inaitwa Profile Based Noise Reduction (a.k.a. PNR (Private Passenger Name)