Can anyone suggests some basic readings for video processing?
I recommend Video Tracking: Theory and Practice  as comprehensive overview of what have been done in this area for last 15 years. Also, 3D Computer Vision: Efficient Methods and Applications for quick understanding useful algorithms.

This books will be a good start, but when you have enough knowledge, you should start looking into research papers, because information there is more updated than in books.