Is there a device which replaces soldered pin headers?
Pogo pins are one method of making a test or programming jigs.

The alternative is another connector like press fit headers. These use friction and sometimes displacement to cut into the pcb. Functionally identical to soldering headers, but without the soldering.