Register images from a camera which has undergone pure forward translation
Without knowing a decomposition of the scene into objects and the depth of each object (distance to each object), it's not possible to achieve what you want.  A very-close object will be affected much more by the translation than a very-distant object.