 Entropy is often defined as a measurement of disorder, or randomness, but this can be misleading.For Shannon's purposes, the entropy of a system is the number of possible states that the system has the capacity to be in.Any one of these potential states can constitute a message.