XMega not responding PDI/avrdude
Curiosity killed the cat.

I tried with a different programmer (Olimex AVR-ISP-MK2) and got similar result. I then tried probing the supply voltage instead, and the response changed. Removing the scope probes and the xmega responded fine. I haven't retried with the original programmer.