Why is the backprojection of the Middlesbury depth map "cone shaped"?
The reason that pixels get wider with depth is that the depth map works in projection space, so each pixel is basically shaped like a frustum, not like a box.  Not sure where the noise is coming from but the depth map doesn't look perfectly clean either.