A peptic ulcer is a sore in the lining of your stomach or your duodenum, the first part of your small intestine. A burning stomach pain is the most common symptom. The pain. 1  Starts between meals or during the night.  Briefly stops if you eat or take antacids.