In fact, too much milk may be bad for your health. The study, conducted with over 60,000 women (age 39-74) and 45,000 men (age 45-79) found that too much milk – three or more glasses a day – was not only associated with mortality but also an increased risk of fracture and hip fracture.