Do I have to turn off "everything" when replacing thermostats?
You should turn off the breaker/fuse that powers the furnace as you could accidentally short circuit the 24V transformer when installing the new thermostat.  If this ever did happen there is usually a 5A fuse on the circuit board you can replace.