Is there a rule of thumb for zero padding in image processing? I see there are a lot of answers on why zero padding is necessary and how it avoids wrapping around the sides of images. However is there a rule of thumb on how much padding will be good for the image processing? I am mainly thinking from the point of view of:

a.) speed of processing the image 

b.) noise 

I have till now referred to the following answers:


Why images need to be padded before filtering in frequency domain
Advantages/disadvantage of zero padding
FFT Zero Padding - Amplitude Change


Response will be really appreciated.

Thank you.
See Press et al. "Numerical Recipes in C++". Chapter 13 on "Fourier and Spectral Applications", Section 13.1 with a subsection entitled "Treatment of end effects by zero padding".  This is perhaps the best summary of zero-padding anywhere in the literature (but it's not referenced in either the contents or index).  My edition of this book is the 2002 second edition and the page number there is 545.