Equivariance vs Invariance in Convolutional Neural Networks
Several answers have been provided to the role of equivariance or invariance question &quot;What is the difference between “equivariant to translation” and “invariant to translation”.
Depending on how local they are, scalar and Convolution operators tend to be equivariant, max/min or range are more invariant, and subsampling/pooling can somewhat link those behavior.