Also, when stress affects the immune system, the body can become vulnerable to infection. In the male anatomy, infections to the testes, prostate gland and urethra, can affect normal male reproductive functioning.