There are steps you can take to make sure your milk doesn't go bad, too. ... Seeing your baby squirm or reject your milk should be the first signs to stop feeding it to them. Spradlin says that for the most part, babies will probably let you know if it the milk tastes bad by refusing it and spitting it out.