Can latching relay make the switch if the coil is powered by either of its switching circuits?
I would combine the two supplies with diodes to provide power to the relay coils. And your LED seems to be in the wrong place so I've moved that too: