Does a CR2032 take damage when connected to a 5V rail?
The main supply is not in parallel with the battery. Most often the battery powers RAM chips via a diode, so that main supply can be connected to RAM chips with a transistor. Sometimes both the supplies go through diodes.