Incorporating Radial Distortion in Imaging Model
If you know the radial distortion parameters (e. g. by calibrating the cameras), then you should simply compensate for the distortion before you do structure from motion.  You can either undistort the images before you do anything else, or you can undistort the coordinates of the points that you are trying to match.