Does my total power supply voltage need to equal the sum of the voltages in my circuit in series?
Yes, your thinking of both series and parallel circuits are correct.
The total supply voltage of 6V is correct for 6V worth of 1.5V lamps in series, and total supply of 1.5V is correct for 1.5V lamps in parallel.