Caffeine is also a bladder irritant, which can make an overactive bladder problem worse, he says. Coffee is rich in oxalates, compounds that bind with calcium in the blood to create calcium oxalate, a major component of kidney stones.