Shannon Entropy for Binary Numbers
Take a look at rate-distortion theory, which studies information transmission in settings where a certain distortion is allowed (such as audio, image, or video compression).