1. Take a break and burp. Taking a break from a feeding to burp your baby may help get rid of the hiccups, since burping can get rid of excess gas that may be causing the hiccups. Burping will also help because it places your baby into an upright position.