Information theory from a (very pure) mathematician's perspective
I think you are looking for the topic of "Algorithmic Information Theory" (AIT). 
This area is the collision of information theory and computer science. For example "Information and Randomness: An Algorithmic Perspective" written by cristian calude contains interesting subjects in this area. You can find more in the AIT website.