Replacing a ceiling fan (with a pull chain light) with a 6 bulb chandelier
You hooked the new light up to the 'always-hot' wire (probably red) which ran the ceiling fan.
Use the other 'switched-hot' wire (probably black) instead.