Male and female brain anatomy. Males and females differ in some aspects of their brains, notably the overall difference in size, with men having larger brains on average (between 8% and 13% larger when not corrected for body size), but there are areas of the brain that appear not to be sexually differentiated.