Yeast infections can happen on your nipples or in your breast (commonly called "thrush") from breastfeeding. Yeast thrive on milk and moisture. A yeast infection you get while breastfeeding is different from a vaginal yeast infection. However, it is caused by an overgrowth of the same fungus.