Ask HN: Self-Studying Information Theory
Hello!<p>I want to explore basics of information theory. Despite having math background, I&#x27;ve realized that I lack a comprehensive understanding of key concepts (e.g. entropy) in this area. I am particularly interested in formal connection between compression and intelligence.<p>I&#x27;m currently seeking resources that would work for self-learning, ideally Jupyter notebooks that would allow me to interactively experiment with the simulations&#x2F;examples. In the absence of such resources, a book with exercises section could also work.<p>Thanks!