Quick Answer. The Texas annexation was so controversial because adding Texas to the United States would inflame sectional tensions between the abolitionist North and the slave-holding South. The Whigs were generally opposed to expansion that included slavery, while the Democrats supported such growth. Continue Reading.