What is thrush? Thrush is caused by a yeast called ‘Candida albicans’ and it most commonly affects your baby’s mouth but it can also affect your baby’s digestive system causing diarrhea and vomiting. Thrush in the mouth causes soreness and your baby may become upset at feeding time or start to refuse feeds.