How do I remove the connector covers on thermostat wires?
Those aren't covers. They are permanently crimped connectors, like wire nuts but cheaper and faster. To do work on those wires you'd normally just cut them off and strip the wires fresh.

I'd take Harper's advice though and proceed with extreme caution. It sounds like you're not familiar with thermostat wiring and you can get yourself into real trouble.