Multiplying with positive and negative noise modifier
I've found the solution to my problem! I added the original curve and the noise on seperate Action strips for the same property into the NLA Editor and set the Blending on the Noise to Multiply