Is the VSE multi-threaded?
From my own experience with Blender 2.72, even if it is threaded, it is not very good at utilizing more than 2 cores.

I've also done some benchmark on sequencer performance here: Render times for standard non-3d video.