Have I bricked my ATMEGA3328p by setting
Programming clock speed is limited by the MCUs clock. If the MCU runs on a clock too slow programming at default speed will fail (as you see).

You can lower the programming clock speed by using the -B switch in avrdude, provided that you programmer hardware supports it.