People said things like for instance well females aren't intelligent enough to make choices and er which is, which is clearly pretty silly, and er there was also I think and the uncomfortable erm  prospect that females could in some way or another control the evolution in males which I don't think it appealed to the Victorians either and in fact many social Darwinists like Edward Westermark for example rejected the whole concept of sexual selection as Darwin called it the female choice, because it didn't promote survival of the fittest.