What does the uncertainty principle say about recursive filters? The uncertainty principle is usually stated as a relationship between a continuous signal and that signal's Fourier transform, and says that
$$
\int_{-\infty}^{\infty} \! x^2 f(x) \ \mathrm{dx} \int_{-\infty}^{\infty} \! \xi^2 \hat{f}(\xi) \ \mathrm{d\xi} \ge \frac{1}{16\pi^2}.
$$

Apparently it is somewhat difficult to define an equivalent relationship for discrete time signals, but, for "reasonable" bandlimited signals with "reasonable" transforms, it is basically correct to say that the above holds true of the continuous signal reconstructed from the samples.  For a good overview I found the following non-paywalled paper useful:
Venkatesh, Kumar Raja, Vidyasagar: On the uncertainty inequality as applied to discrete signals, Int'l J. Math. and Math. Sci., 2006:48185, 2006. doi:10.1155/IJMMS/2006/48185.

So I also understand what this says about FIR filters: I can treat my kernel as a signal, apply the uncertainty principle and see that if I want a very narrowband filter, I'm going to have to have a lot of taps.

My question is what does the uncertainty principle say about an IIR filter?  If I have a very narrow band IIR filter it would seem that the uncertainty principle would say that I would have to trade something off.  What?  I can't figure out what the appropriate signal is that I should take the variance of.  Is it continuous reconstruction of the impulse response of my filter?  (I.e., so I should expect a very narrow-band IIR filter to have an extremely long startup transient?)
The uncertainty principle basically says the same thing for IIR filters: "the steeper the filter, the longer the Impulse Response". The only difference between FIR and IIR is that you have to use a somewhat different definition of "filter length".

While all IIR filters are technically infinite, they have very different decay rates. You can define a quantity that basically describes "energy decay over time". For most IIR filters this is an exponential decay (often dominated by the pole-pair closest to the unit circle) and the decay rate is directly related to the filter bandwidth. 

An interesting quantitative approach to determining decay rates can be found in the area of reverb time calculation, using "time reversed impulse response integration".