Poor performance with h.264 VSE
As far as I know, the Sequencer has no multi-core support in the final rendering. (Surprisingly it has it for rendering proxy files). Also GPU rendering isn't available either.

I just found a recent thread in which a dev claims to work on multi-core support, so maybe it will come in the future. I definitely would appreciate such a feature.