Cannot Edit the Length of VSE's Transform Efffect
Try cutting the strip at the places you want the zoom to occur. Then add the Transform effect to only this short strip. You can add keyframes by hovering over the scale value and pressing the i-key. Use the F-curve editor to change the keyframes in time.