iOS birthday calendar duplicates not removable
What email addresses that you have added to your device have calendar checked on as an option?

Its likely that your calendars are the possible culprit. Try turning off the ones you don't need.