Caffeine. A common cause of stomach irritation from drinking green tea is its caffeine content. Green tea is not fermented like black tea or oolong tea, so typically it has a lower amount of caffeine, but it can still cause an upset stomach.