Medications and dietary supplements that can irritate your esophagus and cause heartburn pain include: 1  Antibiotics, such as tetracycline.  Bisphosphonates taken orally, such as alendronate (Fosamax), ibandronate (Boniva) and risedronate (Actonel)