Is it possible to animate the speed of a strip?
In the VSE with your video strip selected add a speed control effect strip. With the speed control strip selected, in the properties sidebar N under Effect Strip is an option 'Stretch to input strip length', this needs to be off, when it is off you will get a speed factor setting. The speed factor can be keyframed to alter the speed as you want.