circuit for hot-pluggable device
The single most-important feature that your connector must have is that the ground pin makes connection first and breaks last.

Sketch up your circuit and connectors and observe what happens if both of your power supply connections are made but the ground connection is open.  There is a very good chance that both your low-voltage rail AND the signal connections have 24V presented to those nodes.