1. A method for localizing a region of interest in an ego-centric video using a dynamic hand gesture, comprising: capturing, by a processor, the ego-centric video containing the dynamic hand gesture; compensating, by a processor, for a drift of a head-mounted video device during the capturing of the ego-centric video; analyzing, by the processor, a frame of the ego-centric video to detect pixels that correspond to a fingertip using a hand segmentation algorithm; analyzing, by the processor, temporally one or more frames of the ego-centric video to compute a path of the fingertip in the dynamic hand gesture; localizing, by the processor, the region of interest based on the path of the fingertip in the dynamic hand gesture; and performing, by the processor, an action based on an object in the region of interest.