Homography valid for patch within the image but not the entire image?
Are you sure that the points are all in front of the camera (z &gt; 0), if you apply a a projection like $(x, y) = (x/z, y/z)$ then points in a 3d quadrilateral where vertices 0 and 1 have negative z, you could end with a 2d figure like you described