Too much leavener in self-rasing flour?
Self-raising flour shouldn't leave any off flavors, and the recipe looks fine. I suspect the flour, maybe you got a bag that got too much leavening agent in it. Manufacturing processes aren't perfect, sometimes the agents are not distributed. I would suggest trying again with a new bag of flour.