entropy of is The first term on the right approximates the differential entropy, while the second term is approximately . Note that this procedure suggests that the entropy in the discrete sense of a continuous random variable should be . See also Information entropy Self-information Entropy estimation References External links Entropy and information Information theory Statistical randomness