How can I go about making temporary test connections in pcb while prototyping without soldering?
I'll try to answer the questions which aren't already covered in the old question kindly mentioned by Transistor:

How can I make connection on pcb (circuit board) holes without solder (for prototyping)?


  I could use the headers that came with the PCBs but then I'd have to desolder those or buy new PCBs once I had the wiring diagram figured out, which is something I'm also not keen on doing.


You don't have to desolder the headers from the small module later. One approach is to solder standard headers (male or female - your choice, there are benefits to each) into the small modules you buy from Adafruit (or wherever).

While prototyping, you can use "Dupont cables" to make connections to other PCBs, or you might plug the small module (with its headers) directly into a breadboard.

When you have decided on the final design, you fit equivalent opposite-gender headers onto your final PCB / perfboard or whatever. Then plug the small module with its headers, onto those opposite-gender headers which you have soldered onto your final board.

When you are planning this, think about which gender of headers are most suitable for you on each side (module and final board), and which way "up" you want the small module to be, when fitted to the final board.

This is similar the approach used for TI BoosterPacks, Arduino Shields etc. where you "stack" boards using opposite-gender 0.1" pitch headers.