Turning off Power to Thermostat to Replace It
Turns out that for my thermostat, I think I had to wait a bit longer. It took around 10-15 minutes for the display to completely go blank after the breaker was turned off. I think it might have been a large capacitor contributing to this issue, and it was taking a very long time to discharge.