Why is mutual information symmetric, meaning why does I(A,B) = I(B,A)? Isnt the definition of mutual information, I(A,B), something like the reduction of entropy in A when given B? P(A|B) doesnt equal P(B|A) right?
Is mutual information symmetric?
dimensionality reduction