Should I have paid attention to polarity when installing a new light fixture?
Yes, you should fix it. If nothing else, if you crossed the wires, the threads of the socket would be hot, even with the switch off. This would give a good chance of shock when changing the bulb if you’re not careful.