Stephen R. Daniels. pediatrician. No. You shouldn't give your newborn water or sugar water. And if you're feeding powdered or concentrated formula to your baby, never dilute it with more than the amount of water called for on the label. Your infant will get all the necessary hydration from breast milk or formula.