Relay Active Low - What happens with no power?
If the Arduino is disconnected from power then the voltage at the Arduino outputs is undefined...it could be anything. The output pins, even if they happen to be at 0V, will not be able to sink enough current to activate the relay.

This is in fact a dangerous situation for the Arduino. Applying a voltage to the pins of an unpowered microcontroller may damage the pins.