During fertilization, gametes from the sperm combine with gametes from the egg to form a zygote. The zygote contains two sets of 23 chromosomes, for the required 46. All of the gametes in the mother’s eggs possess X chromosomes. The father’s sperm contains about half X and half Y chromosomes. The sperm are the variable factor in determining the sex of the baby.