compact fluorescent lamp noise on digital signals
Are CFLs in an electronics lab a known cause of flipped digital signals in a 3.3 volt circuit?

CFLs are designed to cost little. There is little incentive to control the turn on surge.

As far as your circuit, there are some things that you can do to help in providing immunity. Stop relying on the internal pull up resistance to keep the line high. What you need is a lower impedance. Use external resistors for pull ups. I would use 1K.

The other thing to do is to clean up your wiring. Reduce any loop areas. What I mean by that is for you to consider the loop area of a circuit. If you have an external circuit, look at the complete current path. from the input, to the device, the return conductor, the connection through the board, the complete path current can take to get back to the starting point. Worst case is if the entire path was a circle. Best is two parallel adjoining wires connected to a low impedance source. 

USB chargers are battery chargers and are not a quality power supply. They will have little noise immunity.  A better supply can help, but will only reduce any line disruptions. It can be very likely the problem you are experiencing is coming in through the power supply. 

Anyone with some basic knowledge can put electronics together and make it work. Making a reliable product can be more challenging.