1. A method of processing an image, the method comprising: estimating a binocular disparity map of a middle view among a plurality of views for each of one or more frames using a left image, a middle image, and a right image included in each of the frames, the middle view including the middle image and the estimated binocular disparity map; estimating background views indicating backgrounds of the middle views using depth maps of the middle views of the one or more frames; and detecting a moving object in the middle views, based on differences between the middle views and the background views.