PIC32 having multiple PORTB's "high" at the same time
Use LATx: to write to an output pin

Use PORTx: to read an input pin

For all PICs with LATx registers, all INPUT must be from PORTx and all OUTPUT should be to LATx, which totally avoids the problem of flipping bits when you write to a single bit of the port.