In this study, we investigate the efficacy of bias reduction during training by introducing a new loss function which encourages the language model to equalize the probabilities of predicting gendered word pairs like he and she.  
 Question: what kinds of male and female words are looked at?
gendered word pairs like he and she