Keep in mind, milk allergy symptoms are common for a variety of other food and nonfood allergies, such as hay fever [source: Food Reactions]. If you suspect that you or your child has a milk allergy, talk to your doctor, as a simple allergy test can confirm a milk allergy diagnosis.