Need to learn about Video stitching
I've found 2 useful references:

LEVIN, A., ZOMET, A., PELEG, S., AND WEISS, Y. 2004. Seamless image stitching in the gradient domain. In European Conference on Computer Vision, 377–389.

and

PÉREZ, P., GANGNET, M., AND BLAKE, A. 2003. Poisson image editing. ACM Transactions on Graphics (SIGGRAPH ’03), 313– 318.