dynamic gain control for active noise cancellation circuit
One analog approach is to add an Automatic Gain Control stage to the inverted signal path. The responsiveness of the AGC can be tuned to provide just enough tracking for the envisaged purpose.

If the AGC is placed early enough in the signal path, it will not need to handle much power, making design simpler. 

This is a common enough requirement in analog-based noise cancellation designs that several manufacturers have published relevant app-notes about it. For instance, this page on Mouser might be a useful place to start reading up on it. 

An AGC can be constructed using op-amps, Variable Gain Amplifiers (VGAs), or dedicated audio-use AGC ICs. The specific approach would be determined by preferences such as whether surface mount ICs are an option, and level of distortion that is acceptable.