Answer Wiki. Like many antacids, milk contains calcium. Calcium helps to calm an upset stomach by improving your stomachs pH balance. Milk's thick consistency allows it to coat the lining of your stomach, making milk a good option to take with NSAID medications to avoid stomach upset.