However, even if you can get past the unpleasant taste, drinking spoiled milk isn't a good idea. It can cause food poisoning that may result in uncomfortable digestive symptoms, such as stomach pain, nausea, vomiting, and diarrhea.