It could be the common and sometimes painful oral yeast infection known as thrush. Thrush causes creamy white or yellow patches to appear on the sides, roof, gums, lips, and tongue of a baby's mouth. It also can spread to the throat, tonsils, or esophagus. Thrush is most common in infants and toddlers.