title: Back projecting 3D world point to new view image plane
body: <p>EDIT:</p>
  
  <p>What I have: camera intrinsics, extrinsic from calibration, 2D image and depth map</p>
  
  <p>What I need: 2D virtual view image</p>
  
  <p>I am trying to generate a novel view(right view) for Depth Image Based Rendering. Reason for this is that only the left image and depth map are available at the receiver which has to reconstruct the right view <a href="https://i.stack.imgur.com/5GR94.png" rel="nofollow noreferrer">(see image)</a>.</p>
  
  <p>I want to know if these steps will give me the desired result or what I should be doing instead, </p>
  
  <p>First, by using Camera Calibration toolbox for MATLAB by CalTech, the intrinsic, extrinsic matrices can be obtained.</p>
  
  <p>Then, they can be mapped to 3D world points using calibration parameters by this method "<a href="http://nicolas.burrus.name/index.php/Research/KinectCalibration#tocLink2" rel="nofollow noreferrer">http://nicolas.burrus.name/index.php/Research/KinectCalibration#tocLink2</a>"</p>
  
  <p>Now, I want to back project this to a new image plane(right view). The right view is simply a translation of left and no rotation because of the setup. 
  How do I do this reconstruction?</p>
  
  <p>Also, Can I estimate R and T from MATLAB stereo calibration tool and transform every point in original left view to right view using P2 = R*P1+T, 
  P1 and P2 are image points of 3D world point P in the respective planes.</p>
  
  <p>Any idea and help are highly appreciated, would rephrase/add details if the question is not clear.</p>