Leaving old wiring unconnected in a wall
Disconnect the wires at the thermostat, wire nut, tape and mark for future use and tuck them back into the box. There's no problem just leaving the old heater in place with the wires connected. I don't think a GFCI breaker is required at that location.