FFT: Removed padded zeroes?
To make it clear, you padded your image in what domain ?


Time domain >> No problem, IFFT and then truncate will bring you the original image. It's still intact.
Freq domain >> Padding in the Freq domain means image resizing. You cant get your original image with 100% anymore. If you really want the original size one, the only thing you can do is to resize it back with some resampling methods.