How to wire up a circuit with a button that cancels other circuits
In cases with nontrivial logic like this, it's almost always easier to put a microcontroller with 8 available GPIO pins. Then, set up 4 pins as button inputs and 4 pins as LED outputs. This would be a perfect project for an Arduino board.