Remedies and How to Treat Constipation in Babies. There are many things you can do to help relieve baby’s constipation. You can change baby’s feeding pattern and/or engage in some physical exercises. Tummy Massage – Gently massage and rub baby’s tummy in a clockwise direction.