where the base of the logarithm depends on the units desired for the information, whether bits (log 2 ), nats (log e ), decimal digits (log 10 ), or otherwise. In this work, we will use the natural logarithm. The Shannon entropy, in this context, represents the logarithm of the number of "reasonably probable" data outcomes. The mutual information I(X, Y ) is defined as: