camera tracking an object vs animation
Constraints include an ‘Influence’ property that varies between 1.0 (fully ‘on’) to 0.0 (fully ‘off’). The incluence can be keyframed so that you can vary it as desired. When you want the tracking to affect the camera you would set the influence to 1.0 and when you want to animate the camera you adjust it down to 0.0.