Removing the load of an AC signal to a DC signal
Is one of the output terminals of the power amplifier grounded internally?  It often will be.

If so, then by connecting one of the outputs of the rectifier to ground, you are effectively shorting out the amplifier for one half of each AC cycle.