This step makes it rotation invariant, because we are assuming the rotated image will generate a key point at the same location as the original image. ... Since, SIFT is affine invariant, we can use the SIFT vectors for matching, even if the key point has been slightly deviated due to change in view point.